00000001:02000400:2.0F:1787847129.852728:0:2950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1787847149.723581:0:3176:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787847151.668979:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 689 MB/s 00000001:01000000:3.0:1787847151.926146:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 669 MB/s 00000001:01000000:0.0F:1787847152.181626:0:3237:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3917 MB/s 00000020:02000000:1.0F:1787847153.060335:0:3268:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_87_ge30c52f 00000400:02000000:3.0:1787847154.005797:0:3283:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.121@tcp [8/256/0/180] 00008000:02000000:2.0:1787847157.312888:0:3433:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787847208.763607:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787847218.536328:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787847218.536334:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787847218.536440:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006fdc6fd8 00000080:02000400:1.0:1787847218.536451:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787847218.543279:0:5824:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787847218.543293:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787847218.543332:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002c276796) 00000020:00000080:1.0:1787847218.543351:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787847218.563913:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787847218.564749:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787847218.607460:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787847218.607505:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787847218.607527:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787847218.607656:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787847218.607683:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787847218.608687:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787847218.608695:0:5824:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787847218.608706:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9861846 00000020:01000004:3.0:1787847218.608715:0:5824:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787847218.608719:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787847218.608724:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006fdc6fd8 from MGS 00000020:01000004:3.0:1787847218.608729:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787847218.608751:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000bc8d80b3) 00000020:00000080:3.0:1787847218.608763:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787847218.609247:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006fdc6fd8 from MGS, refs=2 00080000:01000000:3.0:1787847218.609253:0:5824:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787847218.609259:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9861854 00000100:00100000:3.0:1787847218.609497:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787847218.609737:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787847218.609743:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787847218.621290:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787847218.621314:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787847218.622870:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847218.623420:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787847218.623427:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787847218.629682:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787847218.629704:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787847218.631249:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787847218.631261:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787847218.632692:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847218.632698:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847218.632700:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847218.636334:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847218.636342:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847218.636345:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847218.638094:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787847218.641276:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787847218.887074:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3335 MB/s 00000001:01000000:3.0:1787847219.137099:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3895 MB/s 00000001:01000000:2.0:1787847219.387439:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 979 MB/s 00000001:01000000:3.0:1787847219.639609:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 492 MB/s 00080000:10000000:3.0:1787847219.651259:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787847219.680841:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787847219.680869:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787847219.680871:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:3.0:1787847219.681208:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787847219.682450:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787847219.682534:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787847219.682598:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787847219.682833:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787847219.682860:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787847219.683225:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847219.683378:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787847219.683383:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787847219.698055:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787847219.698072:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787847219.700084:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787847219.701895:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787847219.704845:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787847219.704871:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.121@tcp' 00000020:01000004:2.0:1787847219.704873:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787847219.704929:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.121@tcp (typ=mgc) 00000020:00000080:2.0:1787847219.705001:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.121@tcp (000000000be9f262) 00000020:00000080:2.0:1787847219.705018:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787847219.705155:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000026e235db@MGC192.168.201.121@tcp: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1787847219.705307:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.121@tcp-0 is initialized 00000040:01000000:2.0:1787847219.705314:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787847219.712573:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787847219.713225:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.121@tcp (uuid 419007c4-9cf4-45fe-a98f-f6eaa183effb) 00000020:00000080:3.0:1787847219.713254:0:5824:0:(genops.c:1385:class_connect()) connect: client 419007c4-9cf4-45fe-a98f-f6eaa183effb, cookie 0x1835de88b9861862 00000100:00080000:3.0:1787847219.713268:0:5824:0:(import.c:510:import_select_connection()) MGC192.168.201.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787847219.713274:0:5824:0:(import.c:624:import_select_connection()) MGC192.168.201.121@tcp: import 0000000026e235db using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847219.713308:0:5824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c57d545d x1874693616304256/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787847219.713333:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 419007c4-9cf4-45fe-a98f-f6eaa183effb->MGS 00000020:01000004:3.0:1787847219.713350:0:5824:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787847219.713355:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787847219.713368:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000c9839f4b) 00000020:00000080:3.0:1787847219.713381:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787847219.717758:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:419007c4-9cf4-45fe-a98f-f6eaa183effb:3299:1874693616304256:0@lo:250: 00000100:00100000:0.0:1787847219.717874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787847219.718002:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1787847219.723696:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616304256 00000100:00100000:3.0:1787847219.723713:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616304256 00000100:00100000:3.0:1787847219.723758:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787847219.723890:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087c4d74c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1874693616304256:12345-0@lo:250: 00010000:00080000:3.0:1787847219.724009:0:5835:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 419007c4-9cf4-45fe-a98f-f6eaa183effb@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:3.0:1787847219.724039:0:5835:0:(genops.c:1385:class_connect()) connect: client 419007c4-9cf4-45fe-a98f-f6eaa183effb, cookie 0x1835de88b9861870 00000100:00080000:3.0:1787847219.724199:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000729bcc21 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787847219.724292:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087c4d74c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:3299:x1874693616304256:12345-0@lo:250: Request processed in 401us (6418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847219.724300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787847219.724444:0:3299:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787847219.724452:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1787847219.724459:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787847219.724464:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787847219.724467:0:3299:0:(import.c:65:import_set_state_nolock()) 0000000026e235db MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787847219.724469:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787847219.724477:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787847219.724482:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:419007c4-9cf4-45fe-a98f-f6eaa183effb:3299:1874693616304256:0@lo:250: 00000100:00100000:3.0:1787847219.737136:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847219.737379:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787847219.737386:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787847219.740632:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787847219.740645:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1787847219.742839:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1787847219.742848:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787847219.743495:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847219.743684:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787847219.743688:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787847219.744787:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787847219.744797:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787847219.791598:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787847219.791812:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787847219.791819:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787847219.794078:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787847219.794163:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787847219.795660:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787847219.795840:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787847219.795846:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787847219.796769:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787847219.796776:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787847219.798251:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847219.798511:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787847219.798516:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787847219.799383:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787847219.799390:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787847219.800264:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847219.800465:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787847219.800474:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787847219.801430:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787847219.801439:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787847219.833424:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847219.837265:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787847219.837280:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787847219.847349:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787847219.847370:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787847219.854673:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787847219.854696:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787847219.863514:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787847219.863569:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787847219.863577:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787847219.863744:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787847219.863776:0:5824:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787847219.863780:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787847219.863782:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787847219.863783:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847219.863784:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847219.863785:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847219.863786:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847219.863788:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787847219.863789:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787847219.863790:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847219.863791:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847219.863793:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847219.863795:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787847219.863797:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787847219.863799:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787847219.863800:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787847219.863801:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847219.863803:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847219.863804:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847219.863805:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847219.863806:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787847219.863806:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787847219.863807:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847219.863808:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847219.863813:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847219.863814:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787847219.863837:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787847219.863856:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4f627ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304384:0@lo:253: 00000100:00100000:1.0:1787847219.863996:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847219.864046:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000847da5b9 going to sleep for 11 seconds 00000100:00100000:0.0:1787847219.864320:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616304384 00000100:00100000:0.0:1787847219.864327:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616304384 00000100:00100000:0.0:1787847219.864395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847219.864403:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb3e325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:5824:x1874693616304384:12345-0@lo:253: 20000000:01000000:0.0:1787847219.864447:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787847219.864450:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787847219.865149:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787847219.865213:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787847219.865687:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847219.866853:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787847219.867379:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787847219.867384:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787847219.867390:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787847219.867392:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787847219.867407:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787847219.867642:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787847219.867837:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787847219.867852:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787847219.867905:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787847219.868274:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787847219.868329:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787847219.868430:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787847219.868439:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787847219.868709:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787847219.868722:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787847219.868760:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787847219.868768:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787847219.868798:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787847219.868845:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787847219.868882:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787847219.868887:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787847219.868898:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787847219.869563:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787847219.869578:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787847219.869622:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787847219.869681:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787847219.869730:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787847219.869742:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787847219.869830:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787847219.869839:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787847219.869884:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787847219.873808:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787847219.873866:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787847219.873884:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787847219.874102:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787847219.874113:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787847219.874146:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787847219.874181:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787847219.874393:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787847219.874453:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787847219.874460:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787847219.877699:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787847219.878188:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787847219.878216:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.121@tcp for mdt 20000000:01000000:1.0:1787847219.878219:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787847219.878260:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787847219.878268:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787847219.878297:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787847219.878902:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:1.0:1787847219.879002:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787847219.879014:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787847219.879048:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787847219.879082:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787847219.879165:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787847219.879169:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787847219.879173:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787847219.879199:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787847219.879202:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787847219.879237:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787847219.879240:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787847219.880213:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1787847219.880498:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1787847219.880564:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1787847219.880598:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1787847219.880630:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787847219.880632:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787847219.881169:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787847219.881507:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787847219.881632:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787847219.881702:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1787847219.881717:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787847219.881719:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787847219.881724:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787847219.881726:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787847219.881740:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787847219.881747:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1787847219.885787:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787847219.886092:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787847219.902338:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1787847219.902395:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1787847219.902471:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1787847219.902492:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787847219.902512:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902550:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902561:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902568:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902575:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902581:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902587:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000064b9674c already unused, calling callback (00000000d8524e19) 00010000:00010000:1.0:1787847219.902591:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902598:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902629:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902637:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847219.902642:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064b9674c/0x1835de88b9861877 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787847219.902664:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787847220.177582:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb3e325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:5824:x1874693616304384:12345-0@lo:253: Request processed in 313172us (313578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.177602:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847220.177709:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4f627ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304384:0@lo:253: 10000000:01000000:0.0:1787847220.177724:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787847220.177727:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787847220.177743:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787847220.177744:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787847220.177745:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1787847220.177746:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787847220.177747:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787847220.177749:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787847220.177750:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787847220.177751:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787847220.177753:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787847220.177754:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787847220.177777:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006fdc6fd8 from lustre-MDT0000 10000000:01000000:0.0:1787847220.177801:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1787847220.177804:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787847220.177808:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d87c51c33a0 10000000:01000000:0.0:1787847220.177813:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787847220.177821:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d87c51c33a0 from 1 10000000:01000000:0.0:1787847220.177823:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787847220.177857:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.177868:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.177875:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.177894:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304512:0@lo:101: 00000100:00100000:0.0:1787847220.177927:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.178016:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.178075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616304512 00000100:00100000:1.0:1787847220.178091:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616304512 00000100:00100000:1.0:1787847220.178129:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847220.178136:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008536f452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:5824:x1874693616304512:12345-0@lo:101: 00010000:00010000:1.0:1787847220.178148:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847220.178160:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b986187e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.178182:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b986187e expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.178191:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986187e expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.178200:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000064b9674c, rc 0) 00000100:00100000:1.0:1787847220.178246:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008536f452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:5824:x1874693616304512:12345-0@lo:101: Request processed in 111us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.178258:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787847220.178456:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304512:0@lo:101: 00010000:00010000:0.0:1787847220.178468:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.178486:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.178545:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304640:0@lo:501: 00000100:00100000:0.0:1787847220.178569:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.178591:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:3.0:1787847220.178640:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616304640 00000100:00100000:3.0:1787847220.178645:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616304640 00000100:00100000:3.0:1787847220.178676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847220.178681:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051be64c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:5824:x1874693616304640:12345-0@lo:501: 00000100:00100000:3.0:1787847220.178926:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051be64c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:5824:x1874693616304640:12345-0@lo:501: Request processed in 245us (355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787847220.178974:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787847220.179197:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304640:0@lo:501: 10000000:01000000:0.0:1787847220.179225:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787847220.179244:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.179252:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847220.179260:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d87d0568000 10000000:01000000:0.0:1787847220.179264:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787847220.179268:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d87d0568000 10000000:01000000:0.0:1787847220.179270:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787847220.179273:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d87d0568000 from 1 10000000:01000000:0.0:1787847220.179275:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787847220.179292:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.179299:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.179306:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.179328:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304768:0@lo:101: 00000100:00100000:0.0:1787847220.179355:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.179375:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:3.0:1787847220.179564:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616304768 00000100:00100000:3.0:1787847220.179569:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616304768 00000100:00100000:3.0:1787847220.179597:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847220.179603:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009291375c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:5824:x1874693616304768:12345-0@lo:101: 00010000:00010000:3.0:1787847220.179611:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847220.179623:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e83f8445/0x1835de88b9861893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b986188c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.179637:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e83f8445/0x1835de88b9861893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b986188c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.179645:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e83f8445/0x1835de88b9861893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986188c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.179652:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e83f8445, rc 0) 00000100:00100000:3.0:1787847220.179686:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009291375c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+7:5824:x1874693616304768:12345-0@lo:101: Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847220.179693:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787847220.179983:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304768:0@lo:101: 00010000:00010000:0.0:1787847220.179994:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.180002:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847220.180019:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787847220.180032:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.180039:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000009bf3a79e/0x1835de88b986188c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847220.180044:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787847220.180047:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787847220.180052:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d87d0568000 10000000:01000000:0.0:1787847220.180054:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787847220.180057:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787847220.180059:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787847220.180072:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.180077:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.180094:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.180106:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304896:0@lo:101: 00000100:00100000:0.0:1787847220.180134:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.180159:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:3.0:1787847220.180322:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616304896 00000100:00100000:3.0:1787847220.180327:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616304896 00000100:00100000:3.0:1787847220.180356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847220.180361:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005018fd45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+7:5824:x1874693616304896:12345-0@lo:101: 00010000:00010000:3.0:1787847220.180368:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847220.180378:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b986189a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.180389:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b986189a expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.180401:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986189a expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.180406:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc786a75, rc 0) 00000100:00100000:3.0:1787847220.180431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005018fd45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+8:5824:x1874693616304896:12345-0@lo:101: Request processed in 70us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847220.180436:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787847220.180579:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616304896:0@lo:101: 00010000:00010000:0.0:1787847220.180588:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.180595:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.180640:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305024:0@lo:501: 00000100:00100000:0.0:1787847220.180664:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.180685:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.180729:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305024 00000100:00100000:1.0:1787847220.180733:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305024 00000100:00100000:1.0:1787847220.180761:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847220.180767:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6027207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+8:5824:x1874693616305024:12345-0@lo:501: 00000100:00100000:1.0:1787847220.181026:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6027207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5824:x1874693616305024:12345-0@lo:501: Request processed in 258us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.181033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787847220.181155:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305024:0@lo:501: 00000100:00100000:0.0:1787847220.181193:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305152:0@lo:503: 00000100:00100000:0.0:1787847220.181231:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.181253:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.181319:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305152 00000100:00100000:1.0:1787847220.181323:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305152 00000100:00100000:1.0:1787847220.181345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847220.181350:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e81134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5824:x1874693616305152:12345-0@lo:503: 00000100:00100000:1.0:1787847220.181490:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e81134 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5824:x1874693616305152:12345-0@lo:503: Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.181497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787847220.181646:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305152:0@lo:503: 00000100:00100000:0.0:1787847220.182127:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5867:1874693616305280:0@lo:502: 00000100:00100000:0.0:1787847220.182164:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.182192:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000001cfc9a3d going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.182227:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305280 00000100:00100000:1.0:1787847220.182232:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305280 00000100:00100000:1.0:1787847220.182259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847220.182264:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093389f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5867:x1874693616305280:12345-0@lo:502: 00000100:00100000:1.0:1787847220.182487:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093389f64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5867:x1874693616305280:12345-0@lo:502: Request processed in 222us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.182494:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787847220.182625:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5867:1874693616305280:0@lo:502: 00000020:01000000:3.0:1787847220.182648:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847220.182659:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847220.182662:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787847220.182667:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787847220.182671:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847220.182684:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ba13b2ae) 00000020:00000080:3.0:1787847220.182701:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787847220.182707:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787847220.182785:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787847220.182794:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b98618af 00000020:00000080:3.0:1787847220.183262:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787847220.183268:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847220.183272:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847220.183273:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787847220.183275:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847220.183279:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847220.183280:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787847220.183284:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847220.183292:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b7ceaec3) 00000020:00000080:3.0:1787847220.183303:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787847220.183307:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787847220.183315:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787847220.183317:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787847220.183323:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787847220.183381:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006fdc6fd8 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787847220.183403:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006cc38e12) 00000020:00000080:3.0:1787847220.183413:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787847220.183463:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787847220.183469:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b98618c4 00000020:00000080:3.0:1787847220.183576:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787847220.183582:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787847220.183587:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1835de88b98618cb 00080000:01000000:3.0:1787847220.183592:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787847220.183595:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b98618d2 00080000:10000000:3.0:1787847220.184232:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787847220.184429:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1787847220.188337:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787847220.289667:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787847220.290120:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787847220.293896:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787847220.294295:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787847220.332892:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000068fe39cb) 00000020:00000080:2.0:1787847220.334623:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787847220.334730:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787847220.334744:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b98618e0 00000020:00000080:3.0:1787847220.338115:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787847220.344696:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847220.399821:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847220.440626:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847220.490688:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847220.551282:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847220.588881:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787847220.631220:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1835de88b98618e7 00000020:00000080:2.0:1787847220.631559:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787847220.631570:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847220.631576:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847220.631578:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787847220.631582:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847220.631586:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847220.631587:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787847220.631589:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787847220.631591:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787847220.631594:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847220.631606:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847220.631607:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787847220.631610:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847220.631614:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847220.631616:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787847220.631619:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787847220.631656:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787847220.631709:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000047d2d3de pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5867:1874693616305408:0@lo:502: 00000100:00100000:2.0:1787847220.631803:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847220.631863:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000003587d032 going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.632084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305408 00000100:00100000:1.0:1787847220.632092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305408 00000100:00100000:1.0:1787847220.632137:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847220.632145:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075256c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5867:x1874693616305408:12345-0@lo:502: 00000100:00100000:1.0:1787847220.632462:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075256c10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5867:x1874693616305408:12345-0@lo:502: Request processed in 318us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.632470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847220.632532:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000047d2d3de pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5867:1874693616305408:0@lo:502: 00000020:01000000:1.0:1787847220.632556:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787847220.632561:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787847220.632563:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787847220.632566:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787847220.632726:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787847220.632752:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787847220.632766:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.632776:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847220.632783:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87d0568000 from 1 10000000:01000000:1.0:1787847220.632786:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787847220.632813:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.632820:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.632828:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847220.632842:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305536:0@lo:101: 00000100:00100000:1.0:1787847220.632872:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847220.632903:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eae0d07d going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.632925:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305536 00000100:00100000:1.0:1787847220.632976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305536 00000100:00100000:1.0:1787847220.632999:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787847220.633004:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e7a0e8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5824:x1874693616305536:12345-0@lo:101: 00010000:00010000:1.0:1787847220.633013:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847220.633025:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b98618ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.633044:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b98618ee expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.633053:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98618ee expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.633061:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f399d46, rc 0) 00000100:00100000:1.0:1787847220.633088:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e7a0e8b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5824:x1874693616305536:12345-0@lo:101: Request processed in 84us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.633094:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787847220.633132:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305536:0@lo:101: 00010000:00010000:1.0:1787847220.633143:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.633150:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847220.633710:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305664:0@lo:256: 00000100:00100000:1.0:1787847220.633748:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847220.633774:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eae0d07d going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.633799:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305664 00000100:00100000:1.0:1787847220.633804:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305664 00000100:00100000:1.0:1787847220.633824:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847220.633829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0046a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5824:x1874693616305664:12345-0@lo:256: 20000000:01000000:1.0:1787847220.633844:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787847220.633849:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787847220.633909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0046a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5824:x1874693616305664:12345-0@lo:256: Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.633915:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847220.633977:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305664:0@lo:256: 10000000:01000000:1.0:1787847220.634508:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787847220.634534:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634544:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847220.634552:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87d0568000 from 1 10000000:01000000:1.0:1787847220.634554:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787847220.634577:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634584:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634592:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847220.634605:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305792:0@lo:101: 00000100:00100000:1.0:1787847220.634645:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847220.634671:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eae0d07d going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.634692:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305792 00000100:00100000:1.0:1787847220.634696:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305792 00000100:00100000:1.0:1787847220.634721:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847220.634726:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096a89a8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5824:x1874693616305792:12345-0@lo:101: 00010000:00010000:1.0:1787847220.634734:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847220.634744:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b98618fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634760:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b98618fc expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634769:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98618fc expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634776:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000776179ea, rc 0) 00000100:00100000:1.0:1787847220.634802:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096a89a8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616305792:12345-0@lo:101: Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.634808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847220.634839:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305792:0@lo:101: 00010000:00010000:1.0:1787847220.634850:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.634856:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847220.634894:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305920:0@lo:501: 00000100:00100000:1.0:1787847220.634923:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847220.634971:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086dfeca1 going to sleep for 11 seconds 00000100:00100000:1.0:1787847220.634982:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616305920 00000100:00100000:1.0:1787847220.634985:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616305920 00000100:00100000:1.0:1787847220.635002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787847220.635006:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f71e2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616305920:12345-0@lo:501: 00000100:00100000:1.0:1787847220.640447:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f71e2f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616305920:12345-0@lo:501: Request processed in 5431us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847220.640464:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787847220.640848:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000114439cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616305920:0@lo:501: 00000100:00100000:2.0:1787847220.640902:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000421f0c9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306048:0@lo:503: 00000100:00100000:2.0:1787847220.641302:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847220.641376:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000003587d032 going to sleep for 11 seconds 00000100:00100000:0.0:1787847220.641434:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306048 00000100:00100000:0.0:1787847220.641445:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306048 00000100:00100000:0.0:1787847220.641532:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787847220.641541:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df57bd87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616306048:12345-0@lo:503: 00000040:00080000:0.0:1787847220.641587:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787847220.641642:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df57bd87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616306048:12345-0@lo:503: Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847220.641650:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847220.641718:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000421f0c9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306048:0@lo:503: 00000040:00080000:1.0:1787847220.642625:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1787847220.642773:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787847220.642791:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847220.642809:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.642821:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847220.642863:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787847220.642867:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d87d0568000 10000000:01000000:3.0:1787847220.642869:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d87d0568000 10000000:01000000:3.0:1787847220.642873:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787847220.642878:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87d0568000 from 1 10000000:01000000:3.0:1787847220.642890:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847220.642919:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.642959:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.642969:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847220.642988:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306176:0@lo:101: 00000100:00100000:3.0:1787847220.643037:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847220.643498:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017213be3 going to sleep for 11 seconds 00000100:00100000:2.0:1787847220.643580:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306176 00000100:00100000:2.0:1787847220.643588:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306176 00000100:00100000:2.0:1787847220.643633:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787847220.643641:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab965e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616306176:12345-0@lo:101: 00010000:00010000:2.0:1787847220.643653:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847220.643669:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b986190a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847220.643692:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b986190a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847220.643701:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986190a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847220.643709:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cc9bb6d9, rc 0) 00000100:00100000:2.0:1787847220.643759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab965e6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5824:x1874693616306176:12345-0@lo:101: Request processed in 119us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847220.643766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787847220.643855:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306176:0@lo:101: 00010000:00010000:3.0:1787847220.643869:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847220.643877:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847220.643960:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306304:0@lo:501: 00000100:00100000:3.0:1787847220.643988:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847220.644007:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017213be3 going to sleep for 11 seconds 00000100:00100000:2.0:1787847220.644187:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306304 00000100:00100000:2.0:1787847220.644192:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306304 00000100:00100000:2.0:1787847220.644210:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787847220.644215:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000defe3d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5824:x1874693616306304:12345-0@lo:501: 00000100:00100000:2.0:1787847220.644501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000defe3d1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5824:x1874693616306304:12345-0@lo:501: Request processed in 285us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847220.644508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787847220.644706:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306304:0@lo:501: 00000100:00100000:3.0:1787847220.644737:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306432:0@lo:503: 00000100:00100000:3.0:1787847220.644775:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847220.644805:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017213be3 going to sleep for 11 seconds 00000100:00100000:2.0:1787847220.644883:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306432 00000100:00100000:2.0:1787847220.644888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306432 00000100:00100000:2.0:1787847220.644907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787847220.644912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b31fc91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5824:x1874693616306432:12345-0@lo:503: 00000100:00100000:3.0:1787847220.645380:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b31fc91 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5824:x1874693616306432:12345-0@lo:503: Request processed in 467us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847220.645394:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787847220.645477:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306432:0@lo:503: 00000100:00100000:2.0:1787847220.645875:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000421f0c9d pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5872:1874693616306560:0@lo:502: 00000100:00100000:2.0:1787847220.645910:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847220.646030:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000be9d472e going to sleep for 11 seconds 00000100:00100000:0.0:1787847220.646084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306560 00000100:00100000:0.0:1787847220.646090:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306560 00000100:00100000:0.0:1787847220.646115:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787847220.646121:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049cbd30a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5872:x1874693616306560:12345-0@lo:502: 00000100:00100000:0.0:1787847220.646436:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049cbd30a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5872:x1874693616306560:12345-0@lo:502: Request processed in 313us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847220.646443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787847220.646554:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000421f0c9d pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5872:1874693616306560:0@lo:502: 00000020:01000004:2.0:1787847220.646605:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787847220.646617:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000009de3077) 00000020:00000080:2.0:1787847220.646635:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787847220.646709:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006fdc6fd8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787847220.646712:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006fdc6fd8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787847220.646714:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006fdc6fd8 4 00010000:00080000:2.0:1787847220.646738:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000ddca1f4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:3.0:1787847220.648493:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787847220.648764:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787847220.648797:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787847220.648810:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1835de88b986191f 00000100:00080000:3.0:1787847220.648820:0:5872:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787847220.648825:0:5872:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000ddca1f4 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847220.648856:0:5872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dad60fe2 x1874693616306688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787847220.648886:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787847220.649208:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dad60fe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616306688:0@lo:38: 00000100:00100000:0.0:1787847220.649277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.649343:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306688 00000100:00100000:0.0:1787847220.649349:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306688 00000100:00100000:0.0:1787847220.649379:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847220.649386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017fbe10c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616306688:12345-0@lo:38: 00000100:00100000:0.0:1787847220.649438:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017fbe10c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616306688:12345-0@lo:38: Request processed in 51us (160us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787847220.649445:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847220.649483:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787847220.649491:0:3299:0:(import.c:65:import_set_state_nolock()) 000000000ddca1f4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847220.649495:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787847220.649498:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dad60fe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616306688:0@lo:38: 00000100:00100000:3.0:1787847220.650208:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034799e83 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5872:1874693616306816:0@lo:502: 00000100:00100000:3.0:1787847220.650255:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847220.650288:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017213be3 going to sleep for 11 seconds 00000100:00100000:0.0:1787847220.650423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306816 00000100:00100000:0.0:1787847220.650429:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306816 00000100:00100000:0.0:1787847220.650468:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787847220.650475:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdb9667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5872:x1874693616306816:12345-0@lo:502: 00000100:00100000:0.0:1787847220.650735:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdb9667 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5872:x1874693616306816:12345-0@lo:502: Request processed in 261us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847220.650743:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787847220.650852:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034799e83 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:5872:1874693616306816:0@lo:502: 00000040:00080000:3.0:1787847220.650876:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787847220.651072:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787847220.651091:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787847220.651112:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847220.651121:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787847220.651162:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787847220.651164:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787847220.651165:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847220.651166:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847220.651167:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847220.651168:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847220.651170:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787847220.651171:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787847220.651172:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787847220.651172:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787847220.651177:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847220.651178:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847220.651181:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787847220.651183:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787847220.651185:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787847220.651186:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847220.651186:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847220.651187:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847220.651188:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847220.651189:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787847220.651190:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787847220.651191:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787847220.651192:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787847220.651192:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847220.651193:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847220.651206:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787847220.651214:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000421f0c9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306944:0@lo:253: 00000100:00100000:2.0:1787847220.651245:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847220.651268:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9f890e7 going to sleep for 11 seconds 00000100:00100000:0.0:1787847220.651323:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616306944 00000100:00100000:0.0:1787847220.651329:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616306944 00000100:00100000:0.0:1787847220.651393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787847220.651399:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9b4707a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5824:x1874693616306944:12345-0@lo:253: 20000000:01000000:0.0:1787847220.651418:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787847220.651431:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787847220.679678:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787847220.679700:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787847220.679753:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787847220.679761:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787847220.679780:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.679798:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98618ee expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.679807:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.679848:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b98618ee expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847220.679865:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b98618ee expref: 12 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847220.679881:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b87f54b8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1874693616307072:0@lo:104: 00000100:00100000:1.0:1787847220.680007:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847220.680052:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 0000000074655f3f going to sleep for 11 seconds 00000100:00100000:0.0:1787847220.680702:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307072 00000100:00100000:0.0:1787847220.680711:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307072 00000100:00100000:0.0:1787847220.680761:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847220.680769:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018306f13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5859:x1874693616307072:12345-0@lo:104: 00010000:00010000:0.0:1787847220.680781:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.680848:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787847220.680853:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018306f13 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5859:x1874693616307072:12345-0@lo:104: Request processed in 85us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847220.680860:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787847220.680880:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847220.680884:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.680899:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008c8daaa3 already unused, calling callback (00000000afdc0ddf) 10000000:00010000:0.0:1787847220.680902:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.680909:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847220.680915:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847220.680921:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1787847220.681074:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b87f54b8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1874693616307072:0@lo:104: 00010000:00010000:1.0:1787847220.681094:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681264:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681271:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847220.681291:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681297:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 000000008c8daaa3/0x1835de88b98618ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98618f5 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681312:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847220.681314:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847220.681316:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847220.681366:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847220.681377:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616307200:0@lo:103: 00000100:00100000:0.0:1787847220.681410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847220.681452:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307200 00000100:00100000:0.0:1787847220.681456:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307200 00010000:00010000:0.0:1787847220.681480:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98618ee expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.681503:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847220.681509:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfc5feda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3300:x1874693616307200:12345-0@lo:103: 00010000:00010000:0.0:1787847220.681527:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847220.681531:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98618ee expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681541:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b98618ee expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681553:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007f399d46/0x1835de88b98618f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b98618ee expref: 13 pid: 5835 timeout: 285 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681566:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681573:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787847220.681587:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001829445s 00010000:00010000:0.0:1787847220.681590:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681596:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681602:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681607:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681618:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001a1b63c5 already unused, calling callback (00000000d8524e19) 00010000:00010000:0.0:1787847220.681621:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681628:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681639:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.681648:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847220.681675:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfc5feda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3300:x1874693616307200:12345-0@lo:103: Request processed in 167us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847220.681682:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847220.681710:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077b6746c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616307200:0@lo:103: 00010000:00010000:0.0:1787847220.682554:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.682565:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847220.682571:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001a1b63c5/0x1835de88b9861926 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847220.688298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9b4707a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5824:x1874693616306944:12345-0@lo:253: Request processed in 36891us (37043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847220.688317:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787847220.688445:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000421f0c9d pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:5824:1874693616306944:0@lo:253: 10000000:01000000:2.0:1787847220.688461:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787847220.688465:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787847220.688466:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787847220.688468:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847220.688469:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847220.688470:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847220.688471:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847220.688472:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787847220.688474:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787847220.688475:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787847220.688477:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787847220.688479:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847220.688480:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787847220.688493:0:5824:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787847220.694906:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00010000:00010000:1.0:1787847220.695252:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787847220.695755:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787847220.696118:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847220.696281:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787847220.696503:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847220.696686:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787847220.698893:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787847220.699353:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787847220.699581:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787847220.699758:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787847220.700042:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787847220.700214:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787847220.729328:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787847220.758245:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787847220.758514:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787847220.761531:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787847220.761735:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787847220.762202:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787847220.762211:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787847220.762350:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787847220.762773:0:5877:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787847220.762778:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1787847220.764116:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787847220.764660:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787847220.764694:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787847220.765098:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787847220.765313:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787847220.775798:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787847220.776050:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787847220.776230:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787847220.776375:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787847220.776540:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787847220.776685:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787847220.776849:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787847220.777015:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787847220.777184:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787847220.777326:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787847220.777483:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787847220.779200:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787847220.779381:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787847220.779530:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787847220.779682:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787847220.779831:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787847220.780165:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787847220.780295:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787847220.780491:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787847220.780644:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787847220.780799:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787847220.781010:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787847220.781165:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787847220.781309:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787847220.781466:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787847220.781613:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787847220.781757:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787847220.781911:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787847220.782084:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787847220.782238:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787847220.782383:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787847220.792235:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787847220.793144:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787847220.803905:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1787847220.847063:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787847220.847104:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4f1c1d8f988 00100000:10000000:3.0:1787847220.847113:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787847220.851298:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787847220.851316:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787847220.851331:0:5824:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787847220.851361:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787847220.895382:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787847220.895468:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787847220.895472:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787847221.719021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847222.743157:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847223.767196:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847224.792158:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847225.831982:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787847225.955107:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787847225.955119:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787847225.955122:0:8:0:(import.c:65:import_set_state_nolock()) 000000000ddca1f4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787847225.955136:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000ddca1f4 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847225.955285:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847225.955299:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000080f329f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616307328:0@lo:400: 00000100:00100000:0.0:1787847225.955368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847225.955566:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307328 00000100:00100000:2.0:1787847225.955575:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307328 00000100:00100000:2.0:1787847225.955613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787847225.955620:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6c414bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:3303:x1874693616307328:12345-0@lo:400: 00000100:00100000:2.0:1787847225.955672:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6c414bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:3303:x1874693616307328:12345-0@lo:400: Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847225.955679:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787847225.955725:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000080f329f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616307328:0@lo:400: 00000100:00100000:3.0:1787847225.955792:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e0bf8259 x1874693616307456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847225.956135:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e0bf8259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616307456:0@lo:38: 00000100:00100000:2.0:1787847225.956246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847225.956324:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307456 00000100:00100000:3.0:1787847225.956329:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307456 00000100:00100000:3.0:1787847225.956358:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847225.956363:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000421f0c9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1874693616307456:12345-0@lo:38: 00010000:00080000:3.0:1787847225.956385:0:5845:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:3.0:1787847225.956420:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1835de88b986192d 00000004:00100000:3.0:1787847225.956475:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787847225.956588:0:5845:0:(import.c:65:import_set_state_nolock()) 00000000a4cc212a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787847225.956640:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000421f0c9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874693616307456:12345-0@lo:38: Request processed in 276us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847225.956647:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787847225.956967:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e0bf8259 x1874693616307456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787847235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787847225.956984:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787847225.956991:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787847225.956997:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787847225.956999:0:3299:0:(import.c:65:import_set_state_nolock()) 000000000ddca1f4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787847225.957003:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e0bf8259 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616307456:0@lo:38: 00000001:02000400:2.0:1787847226.351699:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787847226.839295:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847227.863145:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847228.889760:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787847229.527145:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787847229.527154:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87d0568000 from 3 10000000:01000000:3.0:1787847229.527159:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787847229.527204:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847229.527217:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847229.527256:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847229.527281:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be921890 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616307584:0@lo:101: 00000100:00100000:3.0:1787847229.527353:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847229.527443:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2e9c4ed going to sleep for 11 seconds 00000100:00100000:0.0:1787847229.527881:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307584 00000100:00100000:0.0:1787847229.527898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307584 00000100:00100000:0.0:1787847229.527971:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787847229.527980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1658de7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616307584:12345-0@lo:101: 00010000:00010000:0.0:1787847229.527992:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847229.528004:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ea1ad65/0x1835de88b986193b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861934 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847229.528025:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ea1ad65/0x1835de88b986193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861934 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847229.528034:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ea1ad65/0x1835de88b986193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861934 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847229.528053:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ea1ad65, rc 0) 00000100:00100000:0.0:1787847229.528099:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1658de7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616307584:12345-0@lo:101: Request processed in 120us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847229.528107:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847229.528285:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be921890 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616307584:0@lo:101: 00010000:00010000:3.0:1787847229.528300:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847229.528307:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847229.528355:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be921890 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616307712:0@lo:256: 00000100:00100000:3.0:1787847229.528397:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847229.528475:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2e9c4ed going to sleep for 11 seconds 00000100:00100000:2.0:1787847229.530643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307712 00000100:00100000:2.0:1787847229.530659:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307712 00000100:00100000:2.0:1787847229.530717:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787847229.530726:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008e1ed3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616307712:12345-0@lo:256: 20000000:01000000:2.0:1787847229.530750:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787847229.531032:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787847229.531036:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787847229.531262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008e1ed3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616307712:12345-0@lo:256: Request processed in 537us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847229.531271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787847229.531335:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be921890 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616307712:0@lo:256: 10000000:01000000:3.0:1787847229.531396:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787847229.531405:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847229.531415:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000fc7af017/0x1835de88b9861934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847229.911065:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847230.951035:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847231.063201:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be921890 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616307840:0@lo:400: 00000100:00100000:2.0:1787847231.063294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847231.063467:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307840 00000100:00100000:1.0:1787847231.063478:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307840 00000100:00100000:1.0:1787847231.063533:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787847231.063543:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb77913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3303:x1874693616307840:12345-0@lo:400: 00000100:00100000:3.0:1787847231.063674:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034799e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616307968:0@lo:400: 00000100:00100000:3.0:1787847231.063717:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847231.063760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616307968 00000100:00100000:3.0:1787847231.063764:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616307968 00000100:00100000:3.0:1787847231.063792:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787847231.063797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0bf8259 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616307968:12345-0@lo:400: 00000100:00100000:3.0:1787847231.063834:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0bf8259 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616307968:12345-0@lo:400: Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847231.063842:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787847231.063881:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000034799e83 x1874693616307968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847231.063896:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034799e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616307968:0@lo:400: 00000100:00100000:1.0:1787847231.075220:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb77913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3303:x1874693616307840:12345-0@lo:400: Request processed in 11666us (11914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847231.075249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787847231.076244:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be921890 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616307840:0@lo:400: 00000020:00000080:1.0:1787847231.249658:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea67c6c70 20000000:00000080:1.0:1787847231.249682:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d87f9ebec00 uarg=0000000000000000 20000000:01000000:1.0:1787847231.249722:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787847231.249731:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787847231.249736:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787847231.250252:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787847231.250266:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787847231.258903:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787847231.259695:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787847231.259833:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787847231.259891:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787847231.259969:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787847231.259986:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.260005:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98618fc expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.260014:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.260053:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b98618fc expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.260069:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b98618fc expref: 11 pid: 5835 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847231.260082:0:6322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000569940c8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1874693616308096:0@lo:104: 00000100:00100000:0.0:1787847231.260157:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847231.260303:0:6322:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c51de177 going to sleep for 11 seconds 00000100:00100000:3.0:1787847231.260580:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308096 00000100:00100000:3.0:1787847231.260590:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308096 00000100:00100000:3.0:1787847231.260683:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847231.260693:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011961e5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:6322:x1874693616308096:12345-0@lo:104: 00010000:00010000:3.0:1787847231.260705:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847231.260813:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787847231.260819:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011961e5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:6322:x1874693616308096:12345-0@lo:104: Request processed in 128us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847231.260827:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787847231.260877:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847231.260885:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.260893:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000276a957a already unused, calling callback (00000000afdc0ddf) 10000000:00010000:2.0:1787847231.260896:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.260904:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847231.260910:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847231.260916:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787847231.260972:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.260978:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847231.260996:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.261003:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 00000000276a957a/0x1835de88b98618fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861903 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.261034:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847231.261036:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847231.261038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847231.261194:0:6322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000569940c8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1874693616308096:0@lo:104: 00010000:00010000:0.0:1787847231.261222:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847231.261494:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054aef77e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616308224:0@lo:103: 00000100:00100000:3.0:1787847231.261533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847231.261656:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308224 00000100:00100000:0.0:1787847231.261662:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308224 00010000:00010000:0.0:1787847231.261685:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98618fc expref: 12 pid: 5835 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847231.261757:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847231.261766:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be921890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3301:x1874693616308224:12345-0@lo:103: 00010000:00010000:0.0:1787847231.261778:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847231.261783:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98618fc expref: 12 pid: 5835 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261794:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b98618fc expref: 12 pid: 5835 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261809:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000776179ea/0x1835de88b9861903 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b98618fc expref: 12 pid: 5835 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261823:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261830:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261842:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261848:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261864:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261869:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261874:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000003b4670c already unused, calling callback (00000000d8524e19) 00010000:00010000:0.0:1787847231.261877:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261883:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261904:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847231.261913:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847231.261981:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be921890 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:3301:x1874693616308224:12345-0@lo:103: Request processed in 216us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847231.261989:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787847231.262070:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054aef77e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616308224:0@lo:103: 00010000:00010000:2.0:1787847231.262210:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.262218:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847231.262224:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000003b4670c/0x1835de88b9861942 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847231.959098:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847232.984547:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847234.007409:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847235.033010:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847236.056110:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847236.191229:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dca09f23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616308352:0@lo:400: 00000100:00100000:0.0:1787847236.191326:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847236.191402:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308352 00000100:00100000:0.0:1787847236.191408:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308352 00000100:00100000:0.0:1787847236.191449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787847236.191456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080a590b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:3302:x1874693616308352:12345-0@lo:400: 00000100:00100000:0.0:1787847236.191501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080a590b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:3302:x1874693616308352:12345-0@lo:400: Request processed in 46us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847236.191525:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787847236.191571:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dca09f23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616308352:0@lo:400: 00000100:00100000:0.0:1787847236.191604:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dca09f23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616308480:0@lo:400: 00000100:00100000:0.0:1787847236.191629:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847236.191674:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308480 00000100:00100000:0.0:1787847236.191678:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308480 00000100:00100000:0.0:1787847236.191717:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847236.191725:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1504cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616308480:12345-0@lo:400: 00000100:00100000:0.0:1787847236.191760:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1504cc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616308480:12345-0@lo:400: Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847236.191766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787847236.191795:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dca09f23 x1874693616308480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847236.191807:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dca09f23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616308480:0@lo:400: 00010000:00010000:3.0:1787847237.080146:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.103108:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787847238.427739:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787847238.427746:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787847238.427895:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000023636eff 00000020:01000004:1.0:1787847238.427918:0:6674:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787847238.427969:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787847238.427985:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000059caa481) 00000020:00000080:1.0:1787847238.428005:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787847238.478065:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787847238.478417:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787847238.520911:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787847238.526166:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787847238.526203:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787847238.526280:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787847238.526306:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787847238.531033:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787847238.531047:0:6674:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787847238.531061:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1835de88b9861950 00000020:01000004:2.0:1787847238.531069:0:6674:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787847238.531091:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787847238.531094:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787847238.531101:0:6674:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787847238.531104:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787847238.531116:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000ab997a4d) 00000020:00000080:2.0:1787847238.531128:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787847238.536517:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787847238.539836:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787847238.539846:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787847238.540574:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787847238.540589:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787847238.542747:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787847238.542759:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787847238.544789:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847238.545046:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787847238.545053:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787847238.545913:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787847238.545921:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787847238.587226:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847238.587467:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787847238.587474:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787847238.597300:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787847238.597410:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787847238.602557:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787847238.602762:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787847238.607339:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847238.607545:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787847238.607560:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787847238.608493:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787847238.608502:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787847238.657376:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787847238.657640:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787847238.657656:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787847238.658701:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787847238.658711:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787847238.659189:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787847238.659223:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787847238.659229:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787847238.682691:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787847238.682730:0:6674:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787847238.682735:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787847238.682737:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787847238.682738:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847238.682739:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847238.682741:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847238.682742:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847238.682743:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787847238.682745:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787847238.682747:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787847238.682748:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847238.682750:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787847238.682754:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787847238.682756:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787847238.682757:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787847238.682758:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847238.682759:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847238.682760:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847238.682761:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847238.682767:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787847238.682768:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787847238.682769:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787847238.682769:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847238.682770:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787847238.682798:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787847238.682817:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007415d681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616308608:0@lo:253: 00000100:00100000:3.0:1787847238.682889:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.683041:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000004eaaba27 going to sleep for 11 seconds 00000100:00100000:1.0:1787847238.683116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308608 00000100:00100000:1.0:1787847238.683123:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308608 00000100:00100000:1.0:1787847238.683194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787847238.683201:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092ebe1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616308608:12345-0@lo:253: 20000000:01000000:1.0:1787847238.683242:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787847238.683246:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787847238.683251:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787847238.683254:0:5838:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787847238.684306:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787847238.684546:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787847238.684561:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787847238.684604:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787847238.684764:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787847238.684791:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787847238.684826:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787847238.685131:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787847238.685151:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:1.0:1787847238.685153:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787847238.685184:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787847238.685190:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787847238.685235:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787847238.685240:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:1.0:1787847238.685259:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787847238.685265:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787847238.685279:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787847238.685303:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787847238.686105:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787847238.686124:0:5838:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:1.0:1787847238.686126:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:1.0:1787847238.686156:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787847238.686162:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787847238.686179:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787847238.686183:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:1.0:1787847238.686223:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787847238.686229:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787847238.686248:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787847238.686265:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787847238.686275:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787847238.686277:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787847238.686281:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787847238.686282:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787847238.686283:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787847238.686293:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787847238.686300:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787847238.686326:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787847238.686328:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787847238.687784:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787847238.687869:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787847238.687910:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787847238.688246:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787847238.688275:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787847238.688292:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787847238.688299:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787847238.688301:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787847238.688722:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787847238.688897:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787847238.688919:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787847238.689042:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787847238.689052:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787847238.689053:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787847238.689366:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787847238.689399:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787847238.689429:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787847238.689679:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787847238.689705:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787847238.689733:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:1.0:1787847238.689745:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787847238.689759:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.689773:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986187e expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.689778:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986189a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.689781:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986190a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.689785:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.689816:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b986190a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.689837:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b986190a expref: 11 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.689852:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df44f971 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874693616308736:0@lo:104: 00000100:00100000:1.0:1787847238.689909:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787847238.690030:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b986189a expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.690039:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b986189a expref: 11 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.690047:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f192e199 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874693616308864:0@lo:104: 00000100:00100000:1.0:1787847238.690064:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787847238.690203:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b986187e expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.690218:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b986187e expref: 11 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.690225:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039d4f91f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874693616308992:0@lo:104: 00000100:00100000:1.0:1787847238.690248:0:5838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.690314:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308736 00000100:00100000:3.0:1787847238.690322:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308736 00000100:00100000:3.0:1787847238.690357:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308864 00000100:00100000:3.0:1787847238.690360:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308864 00000100:00100000:3.0:1787847238.690372:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847238.690378:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000574467a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:5838:x1874693616308736:12345-0@lo:104: 00010000:00010000:3.0:1787847238.690389:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690441:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787847238.690445:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000574467a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:5838:x1874693616308736:12345-0@lo:104: Request processed in 68us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.690452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847238.690471:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847238.690477:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4378ddf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5838:x1874693616308864:12345-0@lo:104: 00010000:00010000:3.0:1787847238.690484:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690514:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787847238.690518:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4378ddf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5838:x1874693616308864:12345-0@lo:104: Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.690523:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787847238.690546:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847238.690550:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690558:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f6c81ac4 already unused, calling callback (00000000afdc0ddf) 10000000:00010000:3.0:1787847238.690561:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690567:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847238.690573:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847238.690592:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847238.690627:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690633:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847238.690651:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690656:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 00000000f6c81ac4/0x1835de88b986190a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861911 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690669:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847238.690670:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690675:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000040675480 already unused, calling callback (00000000afdc0ddf) 10000000:00010000:3.0:1787847238.690677:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690688:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847238.690693:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847238.690698:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847238.690710:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690716:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847238.690720:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690725:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 0000000040675480/0x1835de88b986189a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98618a1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.690736:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.690737:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.690739:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847238.690756:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dad60fe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616309120:0@lo:103: 00010000:00010000:0.0:1787847238.690775:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847238.690785:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.690808:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847238.690813:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616309248:0@lo:103: 00000100:00100000:3.0:1787847238.690849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847238.690873:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309120 00000100:00100000:3.0:1787847238.690875:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309248 00000100:00100000:3.0:1787847238.690877:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309248 00000100:00100000:0.0:1787847238.690877:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309120 00010000:00010000:3.0:1787847238.690892:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986189a expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.690893:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986190a expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847238.690919:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787847238.690924:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b250743d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3300:x1874693616309120:12345-0@lo:103: 00010000:00010000:0.0:1787847238.690952:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847238.690957:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986190a expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.690967:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b986190a expref: 13 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.690980:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847238.691009:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b250743d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3300:x1874693616309120:12345-0@lo:103: Request processed in 85us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.691015:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787847238.691029:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787847238.691034:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080f329f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3300:x1874693616309248:12345-0@lo:103: 00010000:00010000:0.0:1787847238.691041:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847238.691044:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986189a expref: 12 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.691051:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b986189a expref: 12 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.691060:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847238.691080:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080f329f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3300:x1874693616309248:12345-0@lo:103: Request processed in 47us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.691086:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847238.691159:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616308992 00000100:00100000:3.0:1787847238.691164:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616308992 00000100:00100000:3.0:1787847238.691180:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847238.691184:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b87f54b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5838:x1874693616308992:12345-0@lo:104: 00010000:00010000:3.0:1787847238.691191:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847238.691197:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57d545d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616309248:0@lo:103: 00000100:00100000:0.0:1787847238.691226:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dad60fe2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616309120:0@lo:103: 00010000:00010000:3.0:1787847238.691239:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787847238.691243:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b87f54b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5838:x1874693616308992:12345-0@lo:104: Request processed in 59us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.691249:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787847238.691261:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847238.691264:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691271:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009d3dbfa3 already unused, calling callback (00000000afdc0ddf) 10000000:00010000:3.0:1787847238.691273:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691278:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847238.691283:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847238.691287:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847238.691312:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691328:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847238.691344:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691350:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 000000009d3dbfa3/0x1835de88b986187e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861885 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847238.691353:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034799e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616309376:0@lo:103: 00010000:00010000:3.0:1787847238.691364:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.691365:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.691366:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847238.691379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847238.691405:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c497106a going to sleep for 11 seconds 00010000:00010000:1.0:1787847238.691419:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cc9bb6d9/0x1835de88b9861911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b986190a expref: 11 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.691429:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df44f971 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874693616308736:0@lo:104: 00010000:00010000:1.0:1787847238.691438:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dc786a75/0x1835de88b98618a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b986189a expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.691458:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f192e199 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874693616308864:0@lo:104: 00000100:00100000:1.0:1787847238.691468:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039d4f91f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5838:1874693616308992:0@lo:104: 00010000:00010000:1.0:1787847238.691485:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.691533:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309376 00000100:00100000:3.0:1787847238.691537:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309376 00010000:00010000:3.0:1787847238.691551:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986187e expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.691576:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847238.691697:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b1441b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:3302:x1874693616309376:12345-0@lo:103: 00010000:00010000:3.0:1787847238.691707:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847238.691710:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986187e expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691718:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b986187e expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691728:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064b9674c/0x1835de88b9861885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b986187e expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691740:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691757:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691769:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691775:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691781:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691787:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691792:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1c0d245 already unused, calling callback (00000000d8524e19) 00010000:00010000:3.0:1787847238.691795:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691803:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691820:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.691830:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847238.691867:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b1441b2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:3302:x1874693616309376:12345-0@lo:103: Request processed in 285us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.691876:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787847238.691959:0:5838:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.691967:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.691973:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1c0d245/0x1835de88b986195e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787847238.691986:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787847238.692273:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034799e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616309376:0@lo:103: 00000100:00100000:3.0:1787847238.718072:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092ebe1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+8:6674:x1874693616308608:12345-0@lo:253: Request processed in 34864us (35176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.718103:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787847238.718289:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007415d681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616308608:0@lo:253: 10000000:01000000:2.0:1787847238.718303:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787847238.718305:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787847238.718307:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847238.718307:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847238.718308:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787847238.718309:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847238.718310:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847238.718311:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847238.718312:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787847238.718313:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847238.718314:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787847238.718330:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000023636eff from lustre-OST0000 10000000:01000000:2.0:1787847238.718422:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787847238.718425:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787847238.718430:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d87c51c33a0 local copy 10000000:01000000:2.0:1787847238.718433:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787847238.718462:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.718470:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.718476:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.718490:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616309504:0@lo:101: 00000100:00100000:2.0:1787847238.718517:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847238.718722:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309504 00000100:00100000:0.0:1787847238.718729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309504 00000100:00100000:2.0:1787847238.718794:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0085f39 going to sleep for 11 seconds 00000100:00100000:0.0:1787847238.718798:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787847238.718806:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ff7c6b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+8:6674:x1874693616309504:12345-0@lo:101: 00010000:00010000:0.0:1787847238.718819:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847238.718832:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bb8036e/0x1835de88b986196c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861965 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.718855:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bb8036e/0x1835de88b986196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861965 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.718865:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bb8036e/0x1835de88b986196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861965 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.718874:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bb8036e, rc 0) 00000100:00100000:0.0:1787847238.718994:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ff7c6b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:6674:x1874693616309504:12345-0@lo:101: Request processed in 189us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.719002:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847238.719086:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616309504:0@lo:101: 00010000:00010000:2.0:1787847238.719099:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.719108:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.719237:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616309632:0@lo:501: 00000100:00100000:2.0:1787847238.719263:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.719325:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0085f39 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.719364:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309632 00000100:00100000:3.0:1787847238.719369:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309632 00000100:00100000:3.0:1787847238.719435:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787847238.719442:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a25fd170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:6674:x1874693616309632:12345-0@lo:501: 00000100:00100000:3.0:1787847238.719684:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a25fd170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:6674:x1874693616309632:12345-0@lo:501: Request processed in 243us (420us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787847238.719693:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787847238.719755:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616309632:0@lo:501: 10000000:01000000:2.0:1787847238.719769:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787847238.719794:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787847238.719804:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.719814:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.719821:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.719839:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787847238.719863:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d87ef8a4000 10000000:01000000:2.0:1787847238.719868:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787847238.719872:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d87c51c33a0 10000000:01000000:2.0:1787847238.719874:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787847238.719877:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d87c51c33a0 from 1 10000000:01000000:2.0:1787847238.719880:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787847238.719899:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.719905:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.719912:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.719923:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616309760:0@lo:101: 00000100:00100000:2.0:1787847238.719976:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.720230:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000009003f2b1 going to sleep for 11 seconds 00000100:00100000:0.0:1787847238.720267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309760 00000100:00100000:0.0:1787847238.720272:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309760 00000100:00100000:0.0:1787847238.720296:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787847238.720302:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9f5ea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:6674:x1874693616309760:12345-0@lo:101: 00010000:00010000:0.0:1787847238.720311:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847238.720330:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009d3dbfa3/0x1835de88b986197a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861973 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720347:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009d3dbfa3/0x1835de88b986197a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861973 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720356:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009d3dbfa3/0x1835de88b986197a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861973 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720363:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009d3dbfa3, rc 0) 00000100:00100000:0.0:1787847238.720445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9f5ea8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616309760:12345-0@lo:101: Request processed in 143us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.720451:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1787847238.720477:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847238.720482:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720490:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000528d2ff7 already unused, calling callback (00000000afdc0ddf) 10000000:00010000:0.0:1787847238.720493:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720500:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847238.720505:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847238.720511:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787847238.720530:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720548:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847238.720565:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720571:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: 00000000528d2ff7/0x1835de88b9861965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x1835de88b986196c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847238.720599:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847238.720601:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847238.720602:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847238.720708:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ab0ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616309888:0@lo:103: 00000100:00100000:0.0:1787847238.720740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.720856:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616309760:0@lo:101: 00010000:00010000:2.0:1787847238.720868:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.720882:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847238.720902:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'nodemap' succeeded (0). 00000100:00100000:1.0:1787847238.720904:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616309888 00000100:00100000:1.0:1787847238.720908:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616309888 00000100:00100000:1.0:1787847238.720962:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847238.720968:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039dd0409 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:3303:x1874693616309888:12345-0@lo:103: 00010000:00010000:1.0:1787847238.720979:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847238.720991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008bb8036e/0x1835de88b986196c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861965 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.721004:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847238.721039:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.721045:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039dd0409 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:3303:x1874693616309888:12345-0@lo:103: Request processed in 78us (306us total) trans 0 rc 0/0 00010000:00010000:2.0:1787847238.721048:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000b3e134e2/0x1835de88b9861973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.721052:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 10000000:01000000:2.0:1787847238.721056:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787847238.721060:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787847238.721066:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787847238.721070:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787847238.721085:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.721091:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.721098:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.721111:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310016:0@lo:101: 00000100:00100000:2.0:1787847238.721136:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.721167:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000009003f2b1 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.721248:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ab0ba84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616309888:0@lo:103: 00000100:00100000:1.0:1787847238.722377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310016 00000100:00100000:1.0:1787847238.722399:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310016 00000100:00100000:1.0:1787847238.722447:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787847238.722455:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d21a304b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:6674:x1874693616310016:12345-0@lo:101: 00010000:00010000:1.0:1787847238.722470:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847238.722486:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1c0d245/0x1835de88b9861988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861981 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.722507:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1c0d245/0x1835de88b9861988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861981 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.722516:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1c0d245/0x1835de88b9861988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861981 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.722523:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1c0d245, rc 0) 00000100:00100000:1.0:1787847238.722708:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d21a304b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310016:12345-0@lo:101: Request processed in 253us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847238.722716:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787847238.723093:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310016:0@lo:101: 00010000:00010000:2.0:1787847238.723108:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.723123:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.723242:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310144:0@lo:501: 00000100:00100000:2.0:1787847238.723273:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.723342:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000009003f2b1 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.723383:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310144 00000100:00100000:3.0:1787847238.723388:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310144 00000100:00100000:3.0:1787847238.723458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787847238.723465:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059b73753 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310144:12345-0@lo:501: 00000100:00100000:3.0:1787847238.723860:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059b73753 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310144:12345-0@lo:501: Request processed in 395us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.723868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787847238.724008:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310144:0@lo:501: 00000100:00100000:2.0:1787847238.724037:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310272:0@lo:503: 00000100:00100000:2.0:1787847238.724076:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.724248:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000009003f2b1 going to sleep for 11 seconds 00000100:00100000:1.0:1787847238.724309:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310272 00000100:00100000:1.0:1787847238.724314:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310272 00000100:00100000:1.0:1787847238.724340:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787847238.724345:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030b2019f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310272:12345-0@lo:503: 00000100:00100000:1.0:1787847238.724516:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030b2019f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310272:12345-0@lo:503: Request processed in 170us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847238.724524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787847238.724623:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310272:0@lo:503: 00000040:00080000:2.0:1787847238.725000:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787847238.725071:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310400:0@lo:502: 00000100:00100000:2.0:1787847238.725106:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.725125:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000009003f2b1 going to sleep for 11 seconds 00000100:00100000:1.0:1787847238.725268:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310400 00000100:00100000:1.0:1787847238.725273:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310400 00000100:00100000:1.0:1787847238.725295:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787847238.725300:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bc27175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310400:12345-0@lo:502: 00000100:00100000:1.0:1787847238.725443:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bc27175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310400:12345-0@lo:502: Request processed in 143us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847238.725455:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787847238.725712:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310400:0@lo:502: 00000040:00080000:2.0:1787847238.726025:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787847238.726075:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787847238.726105:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787847238.726164:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787847238.726218:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787847238.726254:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787847238.726280:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310528:0@lo:502: 00000100:00100000:2.0:1787847238.726324:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.726394:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000009003f2b1 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.726568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310528 00000100:00100000:3.0:1787847238.726574:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310528 00000100:00100000:1.0:1787847238.726696:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787847238.726706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cedb8d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310528:12345-0@lo:502: 00000100:00100000:1.0:1787847238.727043:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cedb8d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310528:12345-0@lo:502: Request processed in 339us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847238.727051:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787847238.727194:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310528:0@lo:502: 00000040:00080000:2.0:1787847238.727303:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787847238.727314:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787847238.728212:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787847238.728222:0:6692:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787847238.728229:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847238.728231:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787847238.728238:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787847238.728259:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000009d9e204e) 00000020:00000080:0.0:1787847238.728279:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787847238.728286:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787847238.728361:0:6692:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000023636eff from lustre-OST0000, refs=2 00080000:01000000:0.0:1787847238.728369:0:6692:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787847238.728375:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1835de88b9861996 00010000:00010000:0.0:1787847238.733466:0:6692:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1787847238.734178:0:6692:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1787847238.736993:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787847238.737321:0:6692:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787847238.745175:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787847238.745883:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787847238.747456:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787847238.747473:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847238.747480:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847238.747482:0:6692:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787847238.747485:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847238.747489:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847238.747490:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787847238.747493:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787847238.747494:0:6692:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787847238.747561:0:6692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847238.747564:0:6692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847238.747565:0:6692:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787847238.747568:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787847238.749723:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787847238.749765:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787847238.749785:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.749797:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: 00000000928e3d9d/0x1835de88b9861981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847238.749824:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ef8a4000 from 1 10000000:01000000:1.0:1787847238.749827:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787847238.749864:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: 00000000776179ea/0x1835de88b986199d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.749871:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: 00000000776179ea/0x1835de88b986199d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.749881:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: 00000000776179ea/0x1835de88b986199d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.749904:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039d4f91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310656:0@lo:101: 00000100:00100000:1.0:1787847238.749990:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847238.750031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310656 00000100:00100000:1.0:1787847238.750045:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310656 00000100:00100000:1.0:1787847238.750085:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787847238.750093:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f4293c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:6674:x1874693616310656:12345-0@lo:101: 00010000:00010000:1.0:1787847238.750105:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847238.750117:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000276a957a/0x1835de88b98619a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b986199d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.750136:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000276a957a/0x1835de88b98619a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b986199d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.750145:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000276a957a/0x1835de88b98619a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986199d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.750152:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000276a957a, rc 0) 00000100:00100000:1.0:1787847238.750181:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f4293c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616310656:12345-0@lo:101: Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847238.750187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787847238.750243:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ede83720 going to sleep for 11 seconds 00000100:00100000:1.0:1787847238.750264:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039d4f91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310656:0@lo:101: 00010000:00010000:1.0:1787847238.750276:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: 00000000776179ea/0x1835de88b986199d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847238.750283:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: 00000000776179ea/0x1835de88b986199d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847238.751155:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039d4f91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310784:0@lo:501: 00000100:00100000:1.0:1787847238.751188:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847238.751263:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ede83720 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.757105:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310784 00000100:00100000:2.0:1787847238.757120:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310784 00000100:00100000:2.0:1787847238.757179:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787847238.757188:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee5443f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616310784:12345-0@lo:501: 00000100:00100000:2.0:1787847238.757541:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee5443f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616310784:12345-0@lo:501: Request processed in 354us (6352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.757550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787847238.757724:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039d4f91f pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310784:0@lo:501: 00000100:00100000:3.0:1787847238.757779:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007415d681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310912:0@lo:503: 00000100:00100000:3.0:1787847238.757902:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.757964:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056429e20 going to sleep for 11 seconds 00000100:00100000:0.0:1787847238.758024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616310912 00000100:00100000:0.0:1787847238.758029:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616310912 00000100:00100000:0.0:1787847238.758068:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787847238.758074:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018735e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616310912:12345-0@lo:503: 00000100:00100000:0.0:1787847238.758298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018735e6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616310912:12345-0@lo:503: Request processed in 224us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.758306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787847238.758922:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007415d681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616310912:0@lo:503: 00000040:00080000:3.0:1787847238.759250:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787847238.759313:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007415d681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311040:0@lo:502: 00000100:00100000:3.0:1787847238.759364:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.759388:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000056429e20 going to sleep for 11 seconds 00000100:00100000:0.0:1787847238.759730:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311040 00000100:00100000:0.0:1787847238.759736:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311040 00000100:00100000:0.0:1787847238.759770:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787847238.759776:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c3c6468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616311040:12345-0@lo:502: 00000100:00100000:0.0:1787847238.761034:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c3c6468 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616311040:12345-0@lo:502: Request processed in 1250us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.761048:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787847238.762032:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007415d681 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311040:0@lo:502: 00000040:00080000:2.0:1787847238.762401:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787847238.762470:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787847238.762512:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311168:0@lo:502: 00000100:00100000:2.0:1787847238.762599:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.762650:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0085f39 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.763075:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311168 00000100:00100000:3.0:1787847238.763083:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311168 00000100:00100000:3.0:1787847238.763136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787847238.763144:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d22fea86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616311168:12345-0@lo:502: 00000100:00100000:3.0:1787847238.763367:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d22fea86 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616311168:12345-0@lo:502: Request processed in 224us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.763374:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787847238.763558:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a128a217 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311168:0@lo:502: 00000040:00080000:2.0:1787847238.763875:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787847238.763889:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787847238.764552:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847238.764563:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847238.764566:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787847238.764572:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87ef8a4000 00000020:00000080:2.0:1787847238.764574:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787847238.764771:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847238.764775:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847238.764777:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787847238.764780:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787847238.765112:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787847238.765135:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847238.765266:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.765279:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847238.765322:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787847238.765326:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d87ef8a4000 10000000:01000000:3.0:1787847238.765329:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d87ef8a4000 10000000:01000000:3.0:1787847238.765333:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787847238.765339:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87ef8a4000 from 1 10000000:01000000:3.0:1787847238.765342:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847238.765374:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.765383:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.765395:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.765428:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311296:0@lo:101: 00000100:00100000:3.0:1787847238.765498:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.765545:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.765801:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311296 00000100:00100000:2.0:1787847238.765809:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311296 00000100:00100000:2.0:1787847238.765859:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787847238.765868:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616311296:12345-0@lo:101: 00010000:00010000:2.0:1787847238.765881:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847238.765894:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b98619ab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.765915:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b98619ab expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.765926:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619ab expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.765962:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152aa00, rc 0) 00000100:00100000:2.0:1787847238.766004:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311296:12345-0@lo:101: Request processed in 138us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.766011:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787847238.766250:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311296:0@lo:101: 00010000:00010000:3.0:1787847238.766266:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.766274:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.766381:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311424:0@lo:501: 00000100:00100000:3.0:1787847238.766414:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.766447:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9ce780 going to sleep for 11 seconds 00000100:00100000:0.0:1787847238.766500:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311424 00000100:00100000:0.0:1787847238.766505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311424 00000100:00100000:0.0:1787847238.766540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787847238.766558:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311424:12345-0@lo:501: 00000100:00100000:0.0:1787847238.766828:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311424:12345-0@lo:501: Request processed in 271us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847238.766836:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787847238.767045:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311424:0@lo:501: 00000100:00100000:3.0:1787847238.767074:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311552:0@lo:503: 00000100:00100000:3.0:1787847238.767113:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.767139:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.767229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311552 00000100:00100000:2.0:1787847238.767234:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311552 00000100:00100000:2.0:1787847238.767259:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787847238.767266:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311552:12345-0@lo:503: 00000100:00100000:2.0:1787847238.767416:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311552:12345-0@lo:503: Request processed in 149us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.767423:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787847238.767505:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311552:0@lo:503: 00000040:00080000:3.0:1787847238.767807:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787847238.767885:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311680:0@lo:502: 00000100:00100000:3.0:1787847238.767921:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.767972:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.768101:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311680 00000100:00100000:2.0:1787847238.768106:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311680 00000100:00100000:2.0:1787847238.768138:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787847238.768146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311680:12345-0@lo:502: 00000100:00100000:2.0:1787847238.768319:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311680:12345-0@lo:502: Request processed in 174us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.768327:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787847238.768564:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311680:0@lo:502: 00000040:00080000:3.0:1787847238.768969:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787847238.769031:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787847238.769064:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787847238.769107:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787847238.769141:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787847238.769187:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787847238.769235:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787847238.769272:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787847238.769319:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787847238.769355:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787847238.769390:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787847238.769436:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787847238.769470:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787847238.769501:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787847238.769547:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787847238.769820:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787847238.769863:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787847238.769925:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787847238.770329:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787847238.770367:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787847238.770417:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787847238.770471:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787847238.770508:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787847238.770560:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787847238.770842:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787847238.770881:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787847238.771725:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787847238.771799:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787847238.771854:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311808:0@lo:502: 00000100:00100000:3.0:1787847238.772044:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.772129:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.772829:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311808 00000100:00100000:2.0:1787847238.772841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311808 00000100:00100000:2.0:1787847238.772905:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787847238.772916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311808:12345-0@lo:502: 00000100:00100000:3.0:1787847238.773764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616311808:12345-0@lo:502: Request processed in 846us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.773785:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787847238.774002:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616311808:0@lo:502: 00000040:00080000:0.0:1787847238.774118:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787847238.774135:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787847238.774696:0:6697:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787847238.774710:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d86c18bcd70) 00000020:00000080:0.0:1787847238.774732:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787847238.774805:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87ef8a4000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787847238.774810:0:6697:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87ef8a4000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787847238.774813:0:6697:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87ef8a4000 3 00010000:00080000:0.0:1787847238.774847:0:6697:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d87ef029000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.121@tcp at head 00010000:00010000:0.0:1787847238.777224:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787847238.777472:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787847238.777513:0:6697:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787847238.777540:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1835de88b98619c0 00000100:00080000:0.0:1787847238.777552:0:6697:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787847238.777558:0:6697:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d87ef029000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847238.777610:0:6697:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d87d3c1b480 x1874693616311936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787847238.777644:0:6697:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787847238.777716:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616312064:0@lo:400: 00000100:00100000:0.0:1787847238.777790:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.780143:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312064 00000100:00100000:3.0:1787847238.780158:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312064 00000100:00100000:3.0:1787847238.780234:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847238.780245:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616312064:12345-0@lo:400: 00000100:00100000:3.0:1787847238.780340:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616312064:12345-0@lo:400: Request processed in 97us (2550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.780348:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787847238.780403:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d87d3c19e00 x1874693616312064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847238.780418:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616312064:0@lo:400: 00000100:00100000:1.0:1787847238.784456:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616311936:0@lo:38: 00000100:00100000:1.0:1787847238.784549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847238.784648:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616311936 00000100:00100000:1.0:1787847238.784656:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616311936 00000100:00100000:1.0:1787847238.784692:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847238.784700:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1874693616311936:12345-0@lo:38: 00010000:00080000:1.0:1787847238.784727:0:5844:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1787847238.784780:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1835de88b98619c7 00000004:00100000:1.0:1787847238.784796:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787847238.784837:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d87e7d87000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847238.784897:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874693616311936:12345-0@lo:38: Request processed in 196us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847238.784906:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787847238.784964:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d87d3c1b480 x1874693616311936/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787847248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847238.784975:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787847238.784982:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787847238.784990:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787847238.784994:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787847238.784997:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87ef029000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787847238.785002:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616311936:0@lo:38: 00000040:00080000:1.0:1787847238.785975:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787847238.786407:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787847238.786432:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787847238.786452:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.786463:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787847238.786506:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787847238.786508:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847238.786509:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847238.786510:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847238.786511:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847238.786512:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847238.786514:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847238.786515:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787847238.786517:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787847238.786518:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847238.786519:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847238.786524:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787847238.786526:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787847238.786527:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847238.786529:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847238.786530:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847238.786531:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847238.786532:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847238.786536:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847238.786537:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787847238.786538:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787847238.786539:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847238.786540:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847238.786563:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787847238.786580:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616312192:0@lo:253: 00000100:00100000:2.0:1787847238.787024:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.787067:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9cdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847238.787178:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312192 00000100:00100000:0.0:1787847238.787185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312192 00000100:00100000:0.0:1787847238.787247:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787847238.787256:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6674:x1874693616312192:12345-0@lo:253: 20000000:01000000:0.0:1787847238.787282:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787847238.787294:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787847238.815286:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787847238.815311:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787847238.815366:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787847238.815372:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787847238.815395:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.815415:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861934 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.815424:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.815468:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861934 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.815484:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861934 expref: 12 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.815499:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1874693616312320:0@lo:104: 00000100:00100000:3.0:1787847238.815592:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.815655:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9ce180 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.815984:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312320 00000100:00100000:2.0:1787847238.815993:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312320 00000100:00100000:2.0:1787847238.816036:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787847238.816045:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5859:x1874693616312320:12345-0@lo:104: 00010000:00010000:2.0:1787847238.816058:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.816105:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787847238.816110:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5859:x1874693616312320:12345-0@lo:104: Request processed in 67us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.816117:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847238.816324:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1874693616312320:0@lo:104: 00010000:00010000:3.0:1787847238.816343:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816358:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847238.816363:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816370:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d1a00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847238.816374:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816382:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847238.816389:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847238.816395:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847238.816422:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816429:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847238.816444:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816451:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1a00/0x1835de88b9861934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b986193b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816478:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.816480:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847238.816482:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847238.816493:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616312448:0@lo:103: 00000100:00100000:3.0:1787847238.816525:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.816562:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312448 00000100:00100000:3.0:1787847238.816565:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312448 00010000:00010000:3.0:1787847238.816581:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861934 expref: 13 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.816601:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847238.816612:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8718450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3301:x1874693616312448:12345-0@lo:103: 00010000:00010000:3.0:1787847238.816622:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847238.816627:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861934 expref: 13 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816637:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861934 expref: 13 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816649:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031c00/0x1835de88b986193b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861934 expref: 13 pid: 5835 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816661:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816669:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787847238.816681:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001829445s 00010000:00010000:3.0:1787847238.816690:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816698:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816705:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816711:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816716:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d1c00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847238.816719:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816726:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816739:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.816747:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847238.816775:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8718450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3301:x1874693616312448:12345-0@lo:103: Request processed in 168us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.816781:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787847238.817116:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.817126:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.817141:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c29d1c00/0x1835de88b98619ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.817165:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616312448:0@lo:103: 00000100:00100000:3.0:1787847238.825155:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:6674:x1874693616312192:12345-0@lo:253: Request processed in 37889us (38120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.825172:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787847238.825324:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:6674:1874693616312192:0@lo:253: 10000000:01000000:2.0:1787847238.825341:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787847238.825345:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787847238.825347:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847238.825348:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847238.825349:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847238.825350:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847238.825352:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847238.825353:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847238.825355:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787847238.825356:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787847238.825373:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847238.825374:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787847238.825391:0:6674:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787847238.832345:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847238.832544:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787847238.833073:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847238.833297:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787847238.833516:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847238.833802:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787847238.835562:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 10000000:01000000:2.0:1787847238.889772:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787847238.889782:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87d0568000 from 21 10000000:01000000:2.0:1787847238.889789:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787847238.893782:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.893803:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.893904:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.893951:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616312576:0@lo:101: 00000100:00100000:2.0:1787847238.894029:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.894081:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97600 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.894732:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312576 00000100:00100000:2.0:1787847238.894740:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312576 00000100:00100000:2.0:1787847238.894796:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787847238.896118:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616312576:12345-0@lo:101: 00010000:00010000:2.0:1787847238.896144:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847238.908460:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b98619d5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.908506:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b98619d5 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.908520:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619d5 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.908544:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a200, rc 0) 00000100:00100000:2.0:1787847238.908642:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616312576:12345-0@lo:101: Request processed in 13835us (14611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.908651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787847238.908960:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616312576:0@lo:101: 00010000:00010000:3.0:1787847238.908981:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847238.908991:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847238.909064:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616312704:0@lo:501: 00000100:00100000:3.0:1787847238.909101:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847238.909139:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d8841780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.909253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312704 00000100:00100000:2.0:1787847238.909259:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312704 00000100:00100000:2.0:1787847238.909305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787847238.909314:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616312704:12345-0@lo:501: 00000100:00100000:2.0:1787847238.909584:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616312704:12345-0@lo:501: Request processed in 271us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.909592:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787847238.909900:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616312704:0@lo:501: 00000100:00100000:2.0:1787847238.909956:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616312832:0@lo:503: 00000100:00100000:2.0:1787847238.914368:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.914418:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.914553:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312832 00000100:00100000:2.0:1787847238.914561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312832 00000100:00100000:2.0:1787847238.915734:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787847238.915750:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616312832:12345-0@lo:503: 00000100:00100000:2.0:1787847238.916424:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616312832:12345-0@lo:503: Request processed in 675us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.916434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787847238.916512:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616312832:0@lo:503: 00000100:00100000:2.0:1787847238.920608:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6701:1874693616312960:0@lo:502: 00000100:00100000:2.0:1787847238.924749:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.924802:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97900 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.925078:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616312960 00000100:00100000:3.0:1787847238.925086:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616312960 00000100:00100000:3.0:1787847238.925147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787847238.925157:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6701:x1874693616312960:12345-0@lo:502: 00000100:00100000:3.0:1787847238.925416:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6701:x1874693616312960:12345-0@lo:502: Request processed in 260us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.925424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787847238.925578:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6701:1874693616312960:0@lo:502: 00000100:00100000:2.0:1787847238.925656:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6701:1874693616313088:0@lo:502: 00000100:00100000:2.0:1787847238.925692:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.925721:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97900 going to sleep for 11 seconds 00000100:00100000:3.0:1787847238.926058:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313088 00000100:00100000:3.0:1787847238.926064:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313088 00000100:00100000:3.0:1787847238.926096:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787847238.926102:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6701:x1874693616313088:12345-0@lo:502: 00000100:00100000:3.0:1787847238.926262:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:6701:x1874693616313088:12345-0@lo:502: Request processed in 159us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847238.926270:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787847238.927769:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6701:1874693616313088:0@lo:502: 00000040:00080000:2.0:1787847238.927895:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787847238.927988:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787847238.928006:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787847238.928017:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928029:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847238.928040:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787847238.928043:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87d0568000 from 4 10000000:01000000:2.0:1787847238.928046:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787847238.928079:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928088:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928098:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.928118:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313216:0@lo:101: 00000100:00100000:2.0:1787847238.928183:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.928232:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.928250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313216 00000100:00100000:2.0:1787847238.928255:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313216 00000100:00100000:2.0:1787847238.928293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787847238.928302:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616313216:12345-0@lo:101: 00010000:00010000:2.0:1787847238.928313:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847238.928327:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b98619e3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928351:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b98619e3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928362:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619e3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928371:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a000, rc 0) 00000100:00100000:2.0:1787847238.928403:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616313216:12345-0@lo:101: Request processed in 102us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.928410:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787847238.928449:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313216:0@lo:101: 00010000:00010000:2.0:1787847238.928462:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.928470:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.928525:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313344:0@lo:256: 00000100:00100000:2.0:1787847238.928559:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.928572:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.928797:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313344 00000100:00100000:2.0:1787847238.928802:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313344 00000100:00100000:2.0:1787847238.928839:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787847238.928845:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616313344:12345-0@lo:256: 20000000:01000000:2.0:1787847238.928859:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787847238.928874:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787847238.928876:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787847238.928966:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616313344:12345-0@lo:256: Request processed in 120us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.928973:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787847238.929002:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313344:0@lo:256: 10000000:01000000:2.0:1787847238.929036:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787847238.929043:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929051:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847238.929059:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787847238.929061:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787847238.929063:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787847238.929079:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929086:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929102:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.929114:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313472:0@lo:101: 00000100:00100000:2.0:1787847238.929137:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.929158:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97900 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.929170:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313472 00000100:00100000:2.0:1787847238.929173:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313472 00000100:00100000:2.0:1787847238.929192:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787847238.929197:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616313472:12345-0@lo:101: 00010000:00010000:2.0:1787847238.929215:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847238.929225:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b98619f1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929240:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b98619f1 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929250:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619f1 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929257:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a800, rc 0) 00000100:00100000:2.0:1787847238.929284:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616313472:12345-0@lo:101: Request processed in 86us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.929290:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787847238.929316:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313472:0@lo:101: 00010000:00010000:2.0:1787847238.929327:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847238.929345:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847238.929383:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313600:0@lo:501: 00000100:00100000:2.0:1787847238.929405:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.929417:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.929427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313600 00000100:00100000:2.0:1787847238.929430:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313600 00000100:00100000:2.0:1787847238.929451:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787847238.929457:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616313600:12345-0@lo:501: 00000100:00100000:2.0:1787847238.929691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616313600:12345-0@lo:501: Request processed in 233us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.929699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787847238.929733:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313600:0@lo:501: 00000100:00100000:2.0:1787847238.929759:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313728:0@lo:503: 00000100:00100000:2.0:1787847238.929795:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.929808:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.929819:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313728 00000100:00100000:2.0:1787847238.929822:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313728 00000100:00100000:2.0:1787847238.929843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787847238.929848:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616313728:12345-0@lo:503: 00000100:00100000:2.0:1787847238.930041:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616313728:12345-0@lo:503: Request processed in 191us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.930048:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787847238.930085:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616313728:0@lo:503: 00000100:00100000:2.0:1787847238.930752:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6702:1874693616313856:0@lo:502: 00000100:00100000:2.0:1787847238.930799:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847238.930893:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313856 00000100:00100000:2.0:1787847238.930898:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313856 00000100:00100000:2.0:1787847238.930967:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787847238.930977:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:6702:x1874693616313856:12345-0@lo:502: 00000100:00100000:2.0:1787847238.935310:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:6702:x1874693616313856:12345-0@lo:502: Request processed in 4325us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847238.935328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787847238.935403:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b0840 going to sleep for 11 seconds 00000100:00100000:2.0:1787847238.935429:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6702:1874693616313856:0@lo:502: 00000020:01000000:2.0:1787847238.935463:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787847238.935471:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787847238.935477:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847238.935480:0:6702:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787847238.935484:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787847238.935488:0:6702:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:2.0:1787847238.935511:0:6702:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787847238.935513:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787847238.935543:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d86c24cb3a0) 00000020:00000080:2.0:1787847238.935565:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787847238.935572:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787847238.935676:0:6702:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787847238.935682:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787847238.935690:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9861a06 00010000:00080000:2.0:1787847238.935731:0:6702:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d8800585800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1787847238.942875:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787847239.028022:0:6702:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787847239.028054:0:6702:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787847239.028624:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847239.029875:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847239.029947:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787847239.030045:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787847239.036739:0:6703:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847239.036752:0:6703:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787847239.040118:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787847239.040134:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787847239.040176:0:6702:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787847239.040211:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9861a0d 00000100:00080000:2.0:1787847239.040222:0:6702:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787847239.040229:0:6702:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d8800585800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847239.040267:0:6702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d87e13f0000 x1874693616313984/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787847239.040340:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616313984:0@lo:8: 00000100:00080000:2.0:1787847239.040488:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787847239.040567:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847239.040572:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847239.040574:0:6702:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787847239.040589:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847239.040593:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847239.040595:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787847239.040598:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787847239.040600:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787847239.040628:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6702:1874693616314112:0@lo:502: 00000100:00100000:2.0:1787847239.040740:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847239.040777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314112 00000100:00100000:2.0:1787847239.040784:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314112 00000100:00100000:2.0:1787847239.041142:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787847239.041153:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:6702:x1874693616314112:12345-0@lo:502: 00000100:00100000:0.0:1787847239.041171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847239.041243:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616313984 00000100:00100000:0.0:1787847239.041248:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616313984 00000100:00100000:0.0:1787847239.041266:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847239.041271:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1874693616313984:12345-0@lo:8: 00000100:00100000:0.0:1787847239.041318:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1874693616313984:12345-0@lo:8: Request processed in 46us (146us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787847239.041325:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847239.041363:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787847239.041371:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d8800585800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847239.041375:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787847239.041377:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:6702:x1874693616314112:12345-0@lo:502: Request processed in 227us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847239.041379:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616313984:0@lo:8: 00000100:00100000:2.0:1787847239.041383:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787847239.041443:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9cd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847239.041460:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f3840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6702:1874693616314112:0@lo:502: 00000020:01000000:3.0:1787847239.041483:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847239.041489:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847239.041491:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787847239.041496:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787847239.041615:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787847239.041635:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787847239.041645:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847239.041656:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847239.041666:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787847239.041669:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87d0568000 from 1 10000000:01000000:2.0:1787847239.041672:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787847239.041697:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847239.041776:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847239.041788:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847239.041801:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314240:0@lo:101: 00000100:00100000:2.0:1787847239.041968:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847239.041996:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9cd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847239.042040:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314240 00000100:00100000:3.0:1787847239.042044:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314240 00000100:00100000:3.0:1787847239.042123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787847239.042131:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616314240:12345-0@lo:101: 00010000:00010000:3.0:1787847239.042141:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847239.042153:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861a14 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847239.042186:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861a14 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847239.042196:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a14 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847239.042218:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c29d1c00, rc 0) 00000100:00100000:3.0:1787847239.042258:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616314240:12345-0@lo:101: Request processed in 129us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847239.042265:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787847239.042328:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314240:0@lo:101: 00010000:00010000:0.0:1787847239.042343:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847239.042351:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847239.042403:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314368:0@lo:501: 00000100:00100000:0.0:1787847239.042430:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847239.042546:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c20a5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847239.042601:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314368 00000100:00100000:2.0:1787847239.042611:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314368 00000100:00100000:2.0:1787847239.042635:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787847239.042641:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616314368:12345-0@lo:501: 00000100:00100000:2.0:1787847239.042902:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616314368:12345-0@lo:501: Request processed in 260us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847239.042909:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787847239.043085:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314368:0@lo:501: 00000100:00100000:0.0:1787847239.043126:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314496:0@lo:503: 00000100:00100000:0.0:1787847239.043162:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847239.043194:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c20a5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847239.043257:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314496 00000100:00100000:2.0:1787847239.043261:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314496 00000100:00100000:2.0:1787847239.043281:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787847239.043287:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616314496:12345-0@lo:503: 00000100:00100000:2.0:1787847239.043482:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616314496:12345-0@lo:503: Request processed in 195us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847239.043489:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787847239.043571:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314496:0@lo:503: 00000100:00100000:2.0:1787847239.043996:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6705:1874693616314624:0@lo:502: 00000100:00100000:2.0:1787847239.044034:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847239.044055:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314624 00000100:00100000:2.0:1787847239.044059:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314624 00000100:00100000:2.0:1787847239.044079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787847239.044085:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:6705:x1874693616314624:12345-0@lo:502: 00000100:00100000:2.0:1787847239.044229:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:6705:x1874693616314624:12345-0@lo:502: Request processed in 142us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847239.044235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787847239.044270:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847239.044282:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6705:1874693616314624:0@lo:502: 00000020:01000000:2.0:1787847239.044305:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847239.044313:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847239.044315:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787847239.044320:0:6705:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87d0568000 00000020:00000080:2.0:1787847239.044322:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787847239.044341:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6705:1874693616314752:0@lo:502: 00000100:00100000:2.0:1787847239.044372:0:6705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847239.044390:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314752 00000100:00100000:2.0:1787847239.044393:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314752 00000100:00100000:2.0:1787847239.044408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787847239.044422:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:6705:x1874693616314752:12345-0@lo:502: 00000100:00100000:2.0:1787847239.044523:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:6705:x1874693616314752:12345-0@lo:502: Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847239.044529:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787847239.044556:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847239.044568:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f2580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:6705:1874693616314752:0@lo:502: 00000020:01000000:2.0:1787847239.044585:0:6705:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847239.044590:0:6705:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847239.044591:0:6705:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787847239.044594:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787847239.045474:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787847239.045494:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787847239.045504:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847239.045515:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847239.045526:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787847239.045528:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d87c51c33a0 from 1 10000000:01000000:0.0:1787847239.045531:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787847239.045561:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847239.045569:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847239.045579:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847239.045848:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314880:0@lo:101: 00000100:00100000:0.0:1787847239.045894:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847239.047120:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c20a5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847239.048352:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616314880 00000100:00100000:2.0:1787847239.048365:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616314880 00000100:00100000:2.0:1787847239.048606:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787847239.048619:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616314880:12345-0@lo:101: 00010000:00010000:2.0:1787847239.048638:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847239.048657:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861a22 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847239.048688:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861a22 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847239.048710:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a22 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847239.048720:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b000, rc 0) 00000100:00100000:2.0:1787847239.048801:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616314880:12345-0@lo:101: Request processed in 185us (2906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847239.048808:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787847239.048918:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616314880:0@lo:101: 00010000:00010000:0.0:1787847239.048957:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847239.048967:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847239.049032:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616315008:0@lo:501: 00000100:00100000:0.0:1787847239.049068:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847239.049367:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c20a5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847239.049402:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315008 00000100:00100000:3.0:1787847239.049407:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315008 00000100:00100000:3.0:1787847239.049433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787847239.049439:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616315008:12345-0@lo:501: 00000100:00100000:3.0:1787847239.049862:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616315008:12345-0@lo:501: Request processed in 421us (793us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787847239.049871:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787847239.050480:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616315008:0@lo:501: 10000000:01000000:0.0:1787847239.050523:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787847239.050533:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847239.050542:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787847239.061452:0:6674:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787847239.061462:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787847239.061498:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787847239.061556:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787847239.061573:0:6674:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787847239.061735:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787847239.131557:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847240.152291:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847241.176844:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847242.201074:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847243.223173:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847244.256594:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787847244.379374:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787847244.379384:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787847244.379387:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d8800585800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787847244.379411:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d8800585800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847244.379437:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d87e12bda40 x1874693616315520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787847244.379479:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616315264:0@lo:400: 00000100:00100000:3.0:1787847244.379550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847244.379635:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847244.379642:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616315136:0@lo:400: 00000100:00100000:3.0:1787847244.379673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847244.379705:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616315392:0@lo:400: 00000100:00100000:3.0:1787847244.379735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847244.379775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315136 00000100:00100000:3.0:1787847244.379781:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315136 00000100:00100000:3.0:1787847244.379818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787847244.379827:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616315136:12345-0@lo:400: 00000100:00100000:3.0:1787847244.379872:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616315136:12345-0@lo:400: Request processed in 46us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847244.379880:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787847244.379951:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616315136:0@lo:400: 00000100:00100000:1.0:1787847244.382572:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315264 00000100:00100000:1.0:1787847244.382588:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315264 00000100:00100000:1.0:1787847244.382660:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315392 00000100:00100000:1.0:1787847244.382664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315392 00000100:00100000:1.0:1787847244.382700:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847244.382710:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616315264:12345-0@lo:400: 00000100:00100000:1.0:1787847244.382813:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616315264:12345-0@lo:400: Request processed in 104us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847244.382822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847244.382840:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847244.382846:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616315392:12345-0@lo:400: 00000100:00100000:1.0:1787847244.382884:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616315392:12345-0@lo:400: Request processed in 38us (3147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847244.382891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787847244.382952:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12be1c0 x1874693616315392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847244.382966:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616315392:0@lo:400: 00010000:00080000:3.0:1787847244.383175:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12bcb40 x1874693616315264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847244.383187:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616315264:0@lo:400: 00000100:00100000:1.0:1787847244.388428:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616315520:0@lo:8: 00000100:00100000:1.0:1787847244.388517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787847244.388732:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847244.389017:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315520 00000100:00100000:2.0:1787847244.389028:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315520 00000100:00100000:2.0:1787847244.389063:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847244.389071:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1361680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1874693616315520:12345-0@lo:8: 00010000:00080000:2.0:1787847244.389100:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:2.0:1787847244.389136:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9861a30 00002000:00100000:2.0:1787847244.389176:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d86c1832000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113957 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787847244.389181:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787847244.389185:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787847244.392259:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787847244.392493:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787847244.392531:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d86c1837800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847244.392636:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1361680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874693616315520:12345-0@lo:8: Request processed in 3564us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847244.392648:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787847244.392732:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12bda40 x1874693616315520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787847254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787847244.392749:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787847244.392757:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787847244.392763:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787847244.392766:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d8800585800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787847244.392780:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787847244.392785:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616315520:0@lo:8: 00000004:00080000:0.0:1787847244.394191:0:6703:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787847244.394479:0:6703:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 159218546293ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787847244.535472:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787847244.537172:0:6704:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787847244.537205:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616315776:0@lo:7: 00000100:00100000:2.0:1787847244.537289:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847244.537344:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6211540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847244.537360:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847244.537373:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616315648:0@lo:13: 00000100:00100000:2.0:1787847244.537399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847244.537433:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315776 00000100:00100000:2.0:1787847244.537441:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315776 00000100:00100000:2.0:1787847244.537495:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787847244.537504:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6704:x1874693616315776:12345-0@lo:7: 00002000:00080000:2.0:1787847244.542748:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787847244.542758:0:6678:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787847244.542859:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6704:x1874693616315776:12345-0@lo:7: Request processed in 5352us (5566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847244.542870:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787847244.542912:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315648 00000100:00100000:2.0:1787847244.542918:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315648 00000100:00100000:2.0:1787847244.543539:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787847244.543549:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616315648:12345-0@lo:13: 00002000:00000024:2.0:1787847244.543579:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787847244.543625:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616315648:12345-0@lo:13: Request processed in 77us (6224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847244.543630:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787847244.543648:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787847244.543689:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f0b40 x1874693616315776/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787847260 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847244.543704:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616315776:0@lo:7: 00000004:00080000:2.0:1787847244.543716:0:6704:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787847244.543759:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616315904:0@lo:5: 00000100:00100000:2.0:1787847244.543791:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847244.543824:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6211540 going to sleep for 11 seconds 00010000:00080000:2.0:1787847244.543850:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f1e00 x1874693616315648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847244.543864:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616315648:0@lo:13: 00000100:00100000:2.0:1787847244.543887:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616315904 00000100:00100000:2.0:1787847244.543891:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616315904 00000100:00100000:2.0:1787847244.543912:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787847244.543918:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6704:x1874693616315904:12345-0@lo:5: 00002000:00080000:2.0:1787847244.544373:0:6677:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787847244.544379:0:6677:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787847244.544717:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6704:x1874693616315904:12345-0@lo:5: Request processed in 798us (924us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787847244.544725:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787847244.544758:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f0b40 x1874693616315904/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787847260 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847244.544771:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616315904:0@lo:5: 00000004:00080000:2.0:1787847244.544781:0:6704:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787847244.544808:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616316032:0@lo:700: 00000100:00100000:2.0:1787847244.544834:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847244.544853:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6211540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847244.544872:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316032 00000100:00100000:2.0:1787847244.544877:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316032 00000100:00100000:2.0:1787847244.544903:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787847244.544909:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6704:x1874693616316032:12345-0@lo:700: 00000100:00100000:2.0:1787847244.545259:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874693616316160:0@lo:700: 00000100:00100000:2.0:1787847244.545294:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847244.545312:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6211cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847244.545358:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316160 00000100:00100000:2.0:1787847244.545362:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316160 00000100:00100000:2.0:1787847244.545396:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787847244.545403:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874693616316160:12345-0@lo:700: 40000000:02000000:2.0:1787847244.593724:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787847244.601041:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1874693616316160:12345-0@lo:700: Request processed in 55629us (55736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847244.601693:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787847244.601769:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f0000 x1874693616316160/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787847260 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847244.601785:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1874693616316160:0@lo:700: 40000000:02000000:2.0:1787847244.601799:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787847244.688304:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787847244.688323:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787847244.688501:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6704:x1874693616316032:12345-0@lo:700: Request processed in 143587us (143661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847244.688527:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787847244.688581:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f1e00 x1874693616316032/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787847260 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847244.688593:0:6704:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787847244.688610:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616316032:0@lo:700: 00000004:02000040:2.0:1787847244.729407:0:6704:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1787847244.737240:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616316288:0@lo:5: 00000100:00100000:2.0:1787847244.737324:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847244.737434:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0dde000 going to sleep for 11 seconds 00000100:00100000:0.0:1787847244.739624:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316288 00000100:00100000:0.0:1787847244.739635:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316288 00000100:00100000:0.0:1787847244.739700:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787847244.739711:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6704:x1874693616316288:12345-0@lo:5: 00002000:00080000:1.0:1787847244.752491:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787847244.752589:0:6679:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787847244.756184:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6704:x1874693616316288:12345-0@lo:5: Request processed in 16467us (18851us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787847244.756212:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787847244.756313:0:6704:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f1e00 x1874693616316288/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787847260 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847244.756332:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f1e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6704:1874693616316288:0@lo:5: 00000004:00080000:2.0:1787847244.756349:0:6704:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787847245.271616:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787847245.726608:0:7048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787847246.296096:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847247.327039:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847248.343756:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847249.367144:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847249.500753:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616316544:0@lo:400: 00000100:00100000:0.0:1787847249.500849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847249.500955:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847249.500962:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616316416:0@lo:400: 00000100:00100000:0.0:1787847249.500994:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847249.501040:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616316800:0@lo:400: 00000100:00100000:0.0:1787847249.501071:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847249.501091:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847249.501096:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616316672:0@lo:400: 00000100:00100000:0.0:1787847249.501124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847249.501153:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316416 00000100:00100000:0.0:1787847249.501162:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316416 00000100:00100000:0.0:1787847249.501221:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787847249.501231:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616316416:12345-0@lo:400: 00000100:00100000:0.0:1787847249.501290:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616316416:12345-0@lo:400: Request processed in 60us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847249.501299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787847249.501339:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316800 00000100:00100000:0.0:1787847249.501343:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316800 00000100:00100000:0.0:1787847249.501385:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847249.501393:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616316800:12345-0@lo:400: 00000100:00100000:0.0:1787847249.501430:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616316800:12345-0@lo:400: Request processed in 38us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847249.501437:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787847249.501457:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787847249.501492:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87d3c192c0 x1874693616316800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847249.501508:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616316800:0@lo:400: 00000100:00100000:1.0:1787847249.501661:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316544 00000100:00100000:1.0:1787847249.501667:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316544 00000100:00100000:1.0:1787847249.501700:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316672 00000100:00100000:1.0:1787847249.501713:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316672 00000100:00100000:1.0:1787847249.501739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847249.501745:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616316544:12345-0@lo:400: 00000100:00100000:0.0:1787847249.502675:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616316416:0@lo:400: 00000100:00100000:0.0:1787847249.511333:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787847249.511366:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787847249.514966:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787847249.515005:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847249.515037:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616316672:12345-0@lo:400: 00000100:00100000:1.0:1787847249.515169:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616316672:12345-0@lo:400: Request processed in 151us (14043us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847249.515178:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787847249.515249:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87d3c1b840 x1874693616316672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847249.515268:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616316672:0@lo:400: 00000100:00080000:1.0:1787847249.515303:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847249.515442:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616316544:12345-0@lo:400: Request processed in 13695us (14591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847249.515449:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787847249.515493:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87d3c18780 x1874693616316544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847249.515506:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616316544:0@lo:400: 00000100:00100000:0.0:1787847250.007363:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847250.007399:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616316928:0@lo:13: 00000100:00100000:0.0:1787847250.007486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847250.007637:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616316928 00000100:00100000:3.0:1787847250.007648:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616316928 00000100:00100000:3.0:1787847250.007709:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847250.007719:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616316928:12345-0@lo:13: 00002000:00000024:3.0:1787847250.007761:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847250.007817:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616316928:12345-0@lo:13: Request processed in 99us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847250.007824:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787847250.007895:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e13f0000 x1874693616316928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847250.007918:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616316928:0@lo:13: 00000001:00080000:3.0:1787847250.042196:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787847250.392824:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847251.417593:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847252.443759:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847253.465630:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847254.490121:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847254.615209:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616317184:0@lo:400: 00000100:00100000:0.0:1787847254.615286:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847254.615455:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616317056:0@lo:400: 00000100:00100000:2.0:1787847254.615492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847254.615528:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847254.615534:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616317440:0@lo:400: 00000100:00100000:2.0:1787847254.615562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847254.615594:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317056 00000100:00100000:2.0:1787847254.615603:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317056 00000100:00100000:2.0:1787847254.615652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787847254.615661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616317056:12345-0@lo:400: 00000100:00100000:2.0:1787847254.615710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616317056:12345-0@lo:400: Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847254.615717:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787847254.615766:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616317056:0@lo:400: 00000100:00100000:0.0:1787847254.615816:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847254.615823:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616317312:0@lo:400: 00000100:00100000:0.0:1787847254.615849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847254.615971:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317184 00000100:00100000:1.0:1787847254.616046:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317184 00000100:00100000:1.0:1787847254.616083:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317312 00000100:00100000:1.0:1787847254.616086:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317312 00000100:00100000:1.0:1787847254.616117:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847254.616125:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616317184:12345-0@lo:400: 00000100:00100000:1.0:1787847254.616168:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616317184:12345-0@lo:400: Request processed in 44us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847254.616186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847254.616200:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847254.616206:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616317312:12345-0@lo:400: 00000100:00100000:1.0:1787847254.616237:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616317312:12345-0@lo:400: Request processed in 31us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847254.616242:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847254.616262:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317440 00000100:00100000:1.0:1787847254.616266:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317440 00000100:00100000:1.0:1787847254.616294:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787847254.616301:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616317440:12345-0@lo:400: 00000100:00080000:0.0:1787847254.617092:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847254.617100:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787847254.617133:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87d3c19a40 x1874693616317312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847254.617148:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616317312:0@lo:400: 00010000:00080000:0.0:1787847254.617159:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87d3c1a580 x1874693616317184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847254.617168:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616317184:0@lo:400: 00000100:00100000:1.0:1787847254.618189:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616317440:12345-0@lo:400: Request processed in 1882us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847254.618202:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787847254.618258:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87d3c1b480 x1874693616317440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847254.618269:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787847254.618286:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616317440:0@lo:400: 00000100:00100000:2.0:1787847255.130707:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616317568:0@lo:13: 00000100:00100000:2.0:1787847255.130798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847255.130967:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317568 00000100:00100000:3.0:1787847255.130976:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317568 00000100:00100000:3.0:1787847255.131027:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847255.131037:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616317568:12345-0@lo:13: 00002000:00000024:3.0:1787847255.131076:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847255.131123:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616317568:12345-0@lo:13: Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847255.131131:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787847255.131487:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12bda40 x1874693616317568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847255.131508:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616317568:0@lo:13: 00010000:00010000:0.0:1787847255.511057:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847256.546806:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847257.559985:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787847257.991292:0:7616:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787847257.991296:0:7616:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787847257.991432:0:7616:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d87ff957000 00000020:01000004:2.0:1787847257.991454:0:7616:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787847257.991470:0:7616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787847257.991484:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d86c24c99d0) 00000020:00000080:2.0:1787847257.991503:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787847258.024019:0:7616:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787847258.028715:0:7616:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787847258.081084:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787847258.095193:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787847258.095231:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787847258.097047:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787847258.097081:0:7616:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787847258.098877:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787847258.098892:0:7616:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787847258.098915:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1835de88b9861a3e 00000020:01000004:1.0:1787847258.098926:0:7616:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787847258.098964:0:7616:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787847258.098968:0:7616:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787847258.098974:0:7616:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787847258.098998:0:7616:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787847258.099002:0:7616:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787847258.141201:0:7616:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787847258.141860:0:7616:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.121@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1787847258.141875:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787847258.141877:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847258.141879:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847258.141880:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847258.141881:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847258.141882:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847258.141884:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847258.141886:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847258.141887:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847258.141889:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847258.141890:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787847258.141894:0:7616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1787847258.141896:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787847258.141898:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847258.141899:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847258.141900:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847258.141902:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847258.141903:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847258.141904:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847258.141905:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847258.141906:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847258.141908:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847258.141909:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787847258.141964:0:7616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787847258.141987:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616317696:0@lo:253: 00000100:00100000:1.0:1787847258.142060:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.142114:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7a18240 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.142177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317696 00000100:00100000:0.0:1787847258.142185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317696 00000100:00100000:0.0:1787847258.142259:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787847258.142275:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:7616:x1874693616317696:12345-0@lo:253: 20000000:01000000:0.0:1787847258.142313:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787847258.142317:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787847258.142321:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787847258.142324:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787847258.143358:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787847258.143557:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787847258.143571:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787847258.143607:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787847258.143615:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787847258.143644:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787847258.143705:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787847258.144116:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787847258.144137:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:0.0:1787847258.144139:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787847258.144174:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787847258.144182:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787847258.144230:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787847258.144238:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:0.0:1787847258.144269:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787847258.144279:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787847258.144324:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787847258.144387:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787847258.145148:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787847258.145166:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.121@tcp 20000000:01000000:0.0:1787847258.145167:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.121@tcp (null) (null) (null) 00000040:00080000:0.0:1787847258.145202:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787847258.145210:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787847258.145241:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787847258.145249:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.121@tcp (null) (null) 00000040:00080000:0.0:1787847258.145291:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787847258.145301:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787847258.145345:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787847258.145380:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787847258.145395:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787847258.145398:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787847258.145405:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787847258.145406:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787847258.145408:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787847258.145421:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787847258.145425:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787847258.145459:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787847258.145462:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787847258.148551:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787847258.148818:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787847258.148892:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787847258.156491:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787847258.156552:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787847258.156587:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1787847258.156604:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787847258.156606:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787847258.159036:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1787847258.159145:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1787847258.159174:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787847258.159817:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787847258.159875:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787847258.159981:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787847258.159995:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787847258.159998:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787847258.163148:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787847258.163789:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787847258.163839:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787847258.163963:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787847258.163978:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787847258.163980:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787847258.164836:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787847258.164907:0:7620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787847258.165003:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787847258.165563:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787847258.165604:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787847258.165679:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:0.0:1787847258.165697:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787847258.165718:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165736:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861981 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165745:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619ab expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165753:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619d5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165760:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619f1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165767:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a22 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165776:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165815:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861a22 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.165829:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861a22 expref: 16 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.165844:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616317824:0@lo:104: 00000100:00100000:0.0:1787847258.165965:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787847258.166025:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b98619f1 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.166034:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b98619f1 expref: 16 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.166043:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c18780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616317952:0@lo:104: 00010000:00010000:0.0:1787847258.166069:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b98619d5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.166078:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b98619d5 expref: 16 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.166086:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616318080:0@lo:104: 00010000:00010000:0.0:1787847258.166108:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b98619ab expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.166117:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b98619ab expref: 16 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.166124:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616318208:0@lo:104: 00010000:00010000:0.0:1787847258.166145:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861981 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.166153:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861981 expref: 16 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.166161:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d2170000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616318336:0@lo:104: 00000100:00100000:0.0:1787847258.166177:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efba2d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.166496:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787847258.166518:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.166543:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.166551:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.166572:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.166583:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317824 00000100:00100000:2.0:1787847258.166589:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317824 00000100:00100000:2.0:1787847258.166622:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616317952 00000100:00100000:2.0:1787847258.166624:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616317952 00000100:00100000:2.0:1787847258.166633:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318080 00000100:00100000:2.0:1787847258.166635:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318080 00000100:00100000:2.0:1787847258.166643:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318208 00000100:00100000:2.0:1787847258.166645:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318208 00000100:00100000:2.0:1787847258.166652:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318336 00000100:00100000:2.0:1787847258.166654:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318336 00000100:00100000:2.0:1787847258.166664:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787847258.166672:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+7:5835:x1874693616317824:12345-0@lo:104: 00010000:00010000:2.0:1787847258.166684:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.166739:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787847258.166751:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0d97c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+7:5835:x1874693616317824:12345-0@lo:104: Request processed in 79us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.166758:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787847258.166803:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847258.166808:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:5835:x1874693616317952:12345-0@lo:104: 00010000:00010000:2.0:1787847258.166816:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.166850:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787847258.166855:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f1e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:5835:x1874693616317952:12345-0@lo:104: Request processed in 47us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.166860:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847258.166882:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787847258.166889:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:5835:x1874693616318080:12345-0@lo:104: 00010000:00010000:2.0:1787847258.166896:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.166922:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787847258.166927:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:5835:x1874693616318080:12345-0@lo:104: Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.166956:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787847258.166969:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787847258.166975:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:5835:x1874693616318208:12345-0@lo:104: 00010000:00010000:2.0:1787847258.166983:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167007:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787847258.167018:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:5835:x1874693616318208:12345-0@lo:104: Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.167024:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787847258.167035:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787847258.167041:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5835:x1874693616318336:12345-0@lo:104: 00010000:00010000:2.0:1787847258.167049:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167072:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787847258.167076:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5835:x1874693616318336:12345-0@lo:104: Request processed in 36us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.167080:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787847258.167095:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787847258.167100:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167106:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0030e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847258.167110:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167117:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847258.167123:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847258.167128:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787847258.167155:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167169:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847258.167188:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167194:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861a22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a29 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167207:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787847258.167210:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167215:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847258.167217:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.167223:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847258.167228:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847258.167233:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787847258.167244:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167414:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787847258.167537:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787847258.167544:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167551:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847258.167554:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167561:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847258.167567:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847258.167573:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787847258.167598:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167605:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847258.167611:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167618:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152b800/0x1835de88b98619d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619dc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167628:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847258.167632:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167638:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ba00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847258.167646:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167653:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847258.167660:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847258.167666:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787847258.167679:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167685:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847258.167698:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152ba00/0x1835de88b9861981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861988 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.167715:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847258.167717:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847258.167719:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847258.167732:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616318848:0@lo:103: 00000100:00100000:1.0:1787847258.167767:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.167924:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616318464:0@lo:103: 00000100:00100000:1.0:1787847258.167969:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.167987:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787847258.167992:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616318720:0@lo:103: 00000100:00100000:1.0:1787847258.168011:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.168053:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318848 00000100:00100000:1.0:1787847258.168059:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318848 00010000:00010000:1.0:1787847258.168080:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861981 expref: 17 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.168096:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318464 00000100:00100000:1.0:1787847258.168098:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318464 00010000:00010000:1.0:1787847258.168108:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a22 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.168117:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318720 00000100:00100000:1.0:1787847258.168120:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318720 00010000:00010000:1.0:1787847258.168128:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619d5 expref: 19 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.168140:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847258.168147:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616318848:12345-0@lo:103: 00010000:00010000:1.0:1787847258.168158:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847258.168163:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861981 expref: 19 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.168172:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861981 expref: 19 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.168188:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847258.168217:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616318848:12345-0@lo:103: Request processed in 70us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.168224:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847258.168238:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847258.168243:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3300:x1874693616318464:12345-0@lo:103: 00010000:00010000:1.0:1787847258.168263:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847258.168280:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a22 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.168291:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861a22 expref: 18 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.168300:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847258.168326:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3300:x1874693616318464:12345-0@lo:103: Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.168332:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847258.168344:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847258.168350:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1363840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:3300:x1874693616318720:12345-0@lo:103: 00010000:00010000:1.0:1787847258.168358:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847258.168363:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619d5 expref: 17 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.168371:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b98619d5 expref: 17 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.168380:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847258.168398:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1363840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:3300:x1874693616318720:12345-0@lo:103: Request processed in 49us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.168403:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847258.168436:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616318848:0@lo:103: 00000100:00100000:1.0:1787847258.168458:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1363c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616318720:0@lo:103: 00000100:00100000:1.0:1787847258.168464:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616318464:0@lo:103: 00010000:00010000:0.0:1787847258.169021:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b000/0x1835de88b9861a29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861a22 expref: 16 pid: 5838 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.169041:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c19a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616317824:0@lo:104: 00000100:00100000:0.0:1787847258.169062:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c18780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616317952:0@lo:104: 00010000:00010000:0.0:1787847258.169069:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a200/0x1835de88b98619dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b98619d5 expref: 15 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.169076:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616318080:0@lo:104: 00000100:00100000:0.0:1787847258.169083:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a1c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616318208:0@lo:104: 00010000:00010000:0.0:1787847258.169089:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165c400/0x1835de88b9861988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861981 expref: 14 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847258.169096:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d2170000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1874693616318336:0@lo:104: 00010000:00010000:0.0:1787847258.169118:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.169423:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847258.169447:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.169455:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152b200/0x1835de88b98619f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619f8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.169472:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847258.169474:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847258.169476:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847258.169482:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847258.169494:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616318592:0@lo:103: 00000100:00100000:2.0:1787847258.169531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.169576:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318592 00000100:00100000:2.0:1787847258.169580:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318592 00010000:00010000:2.0:1787847258.169601:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619f1 expref: 14 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847258.169621:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787847258.169628:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:3302:x1874693616318592:12345-0@lo:103: 00010000:00010000:2.0:1787847258.169638:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847258.169642:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619f1 expref: 14 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.169652:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b98619f1 expref: 14 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.169665:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a800/0x1835de88b98619f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b98619f1 expref: 14 pid: 5835 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.169674:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847258.169700:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3302:x1874693616318592:12345-0@lo:103: Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.169706:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787847258.169733:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616318592:0@lo:103: 00010000:00010000:1.0:1787847258.170417:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847258.170420:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847258.170428:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847258.170461:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170474:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d0600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847258.170478:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170486:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847258.170493:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847258.170499:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847258.170536:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170542:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847258.170565:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170571:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b98619ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619b2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170584:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847258.170586:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847258.170588:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847258.170694:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616318976:0@lo:103: 00000100:00100000:0.0:1787847258.170736:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.170815:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616318976 00000100:00100000:3.0:1787847258.170820:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616318976 00010000:00010000:3.0:1787847258.170840:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619ab expref: 13 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847258.170879:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787847258.170897:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3300:x1874693616318976:12345-0@lo:103: 00010000:00010000:3.0:1787847258.170908:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847258.170913:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619ab expref: 13 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170923:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b98619ab expref: 13 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170960:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152aa00/0x1835de88b98619b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b98619ab expref: 13 pid: 5837 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170973:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170982:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.170997:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171005:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171012:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171017:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171022:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0031e00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847258.171026:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171039:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171052:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.171060:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847258.171093:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3300:x1874693616318976:12345-0@lo:103: Request processed in 199us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847258.171100:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787847258.171175:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616318976:0@lo:103: 00010000:00010000:0.0:1787847258.171202:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.171210:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.171216:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787847258.171238:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787847258.349215:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:7616:x1874693616317696:12345-0@lo:253: Request processed in 206939us (207146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.349231:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787847258.349374:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616317696:0@lo:253: 10000000:01000000:1.0:1787847258.349389:0:7616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787847258.349461:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787847258.349463:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847258.349464:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847258.349466:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787847258.349467:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847258.349468:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847258.349470:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847258.349472:0:7616:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787847258.349473:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847258.349474:0:7616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787847258.349503:0:7616:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d87ff957000 from lustre-OST0001 10000000:01000000:1.0:1787847258.349526:0:7616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787847258.349529:0:7616:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787847258.349535:0:7616:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d87c51c33a0 local copy 10000000:01000000:1.0:1787847258.349539:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787847258.349570:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.349581:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.349590:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.349607:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319104:0@lo:101: 00000100:00100000:1.0:1787847258.349639:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.349716:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7a18900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.349764:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319104 00000100:00100000:0.0:1787847258.349770:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319104 00000100:00100000:0.0:1787847258.349807:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787847258.349815:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:7616:x1874693616319104:12345-0@lo:101: 00010000:00010000:0.0:1787847258.349826:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847258.349837:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861a4c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.349857:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861a4c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.349879:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a4c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.349888:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c0031e00, rc 0) 00000100:00100000:0.0:1787847258.349920:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319104:12345-0@lo:101: Request processed in 106us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.349926:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787847258.350093:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319104:0@lo:101: 00010000:00010000:1.0:1787847258.350105:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.350120:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.350220:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319232:0@lo:501: 00000100:00100000:1.0:1787847258.350242:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847258.350304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319232 00000100:00100000:0.0:1787847258.350308:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319232 00000100:00100000:0.0:1787847258.350335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787847258.350341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319232:12345-0@lo:501: 00000100:00100000:0.0:1787847258.350530:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319232:12345-0@lo:501: Request processed in 189us (286us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787847258.350542:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787847258.356747:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7a18900 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.356800:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319232:0@lo:501: 10000000:01000000:1.0:1787847258.356829:0:7616:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787847258.356913:0:7616:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787847258.356922:0:7616:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.356948:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.356956:0:7616:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.356989:0:7616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787847258.357023:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d87ff957000 10000000:01000000:1.0:1787847258.357029:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787847258.357036:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787847258.357039:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787847258.357044:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787847258.357047:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787847258.357080:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.357108:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.357119:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.357140:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319360:0@lo:101: 00000100:00100000:1.0:1787847258.357207:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.357240:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7a186c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787847258.357439:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847258.357447:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.357455:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847258.357458:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.357466:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847258.357473:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847258.357479:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787847258.357499:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.357505:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847258.357524:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.357531:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x1835de88b9861a53 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.357544:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847258.357546:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847258.357548:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847258.357558:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616319488:0@lo:103: 00000100:00100000:2.0:1787847258.357588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.357640:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319488 00000100:00100000:2.0:1787847258.357646:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319488 00000100:00100000:2.0:1787847258.357687:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847258.357696:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3301:x1874693616319488:12345-0@lo:103: 00010000:00010000:2.0:1787847258.357708:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847258.357720:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031e00/0x1835de88b9861a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861a4c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.357735:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847258.357767:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:3301:x1874693616319488:12345-0@lo:103: Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.357774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847258.357803:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616319488:0@lo:103: 00000100:00100000:0.0:1787847258.358454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319360 00000100:00100000:0.0:1787847258.358461:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319360 00000100:00100000:0.0:1787847258.358497:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787847258.358504:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:7616:x1874693616319360:12345-0@lo:101: 00010000:00010000:0.0:1787847258.358516:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847258.358528:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861a5a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.358548:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861a5a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.358559:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a5a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.358566:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c0030600, rc 0) 00000100:00100000:0.0:1787847258.358610:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319360:12345-0@lo:101: Request processed in 106us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.358616:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787847258.358697:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319360:0@lo:101: 00010000:00010000:2.0:1787847258.358713:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.358721:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847258.358821:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319616:0@lo:501: 00000100:00100000:2.0:1787847258.358850:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.358889:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746540 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.358964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319616 00000100:00100000:0.0:1787847258.358969:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319616 00000100:00100000:0.0:1787847258.358989:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787847258.358995:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319616:12345-0@lo:501: 00000100:00100000:0.0:1787847258.359499:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319616:12345-0@lo:501: Request processed in 502us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.359506:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787847258.366204:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319616:0@lo:501: 00000100:00100000:3.0:1787847258.366292:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319744:0@lo:503: 00000100:00100000:3.0:1787847258.366386:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.366641:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.366806:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319744 00000100:00100000:0.0:1787847258.366813:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319744 00000100:00100000:0.0:1787847258.366888:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787847258.366897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319744:12345-0@lo:503: 00000100:00100000:0.0:1787847258.367137:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319744:12345-0@lo:503: Request processed in 241us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.367143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787847258.367436:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319744:0@lo:503: 00000040:00080000:3.0:1787847258.367752:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787847258.367819:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319872:0@lo:502: 00000100:00100000:3.0:1787847258.367870:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.367903:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.368050:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616319872 00000100:00100000:1.0:1787847258.368055:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616319872 00000100:00100000:1.0:1787847258.368091:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787847258.368099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319872:12345-0@lo:502: 00000100:00100000:1.0:1787847258.368284:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616319872:12345-0@lo:502: Request processed in 186us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.368292:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787847258.368657:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616319872:0@lo:502: 00000040:00080000:3.0:1787847258.369060:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787847258.369113:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787847258.369141:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787847258.369191:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787847258.369228:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787847258.369652:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787847258.369701:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320000:0@lo:502: 00000100:00100000:3.0:1787847258.369757:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.369837:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.374341:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320000 00000100:00100000:2.0:1787847258.374355:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320000 00000100:00100000:2.0:1787847258.374436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787847258.374446:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616320000:12345-0@lo:502: 00000100:00100000:2.0:1787847258.374737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616320000:12345-0@lo:502: Request processed in 292us (4978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.374751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787847258.375150:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320000:0@lo:502: 00000040:00080000:3.0:1787847258.375360:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787847258.375377:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787847258.379707:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787847258.379722:0:7623:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787847258.379729:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847258.379732:0:7623:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787847258.379739:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847258.379757:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d88008633a0) 00000020:00000080:3.0:1787847258.379782:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787847258.379788:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787847258.379893:0:7623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87ff957000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787847258.379902:0:7623:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787847258.379910:0:7623:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1835de88b9861a6f 00010000:00010000:0.0:1787847258.386205:0:7623:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787847258.386758:0:7623:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787847258.393616:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787847258.393990:0:7623:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787847258.402700:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787847258.403236:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787847258.405210:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787847258.405222:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847258.405228:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847258.405230:0:7623:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787847258.405233:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847258.405238:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847258.405239:0:7623:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787847258.405242:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787847258.405244:0:7623:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787847258.405565:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847258.405570:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847258.405571:0:7623:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787847258.405575:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787847258.417548:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787847258.417590:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787847258.417610:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.417622:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847258.417657:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ff957000 from 1 10000000:01000000:3.0:1787847258.417660:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787847258.417697:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.417704:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.417727:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847258.417750:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320128:0@lo:101: 00000100:00100000:3.0:1787847258.417822:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.417881:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.418144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320128 00000100:00100000:2.0:1787847258.418151:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320128 00000100:00100000:2.0:1787847258.418202:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787847258.418211:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:7616:x1874693616320128:12345-0@lo:101: 00010000:00010000:2.0:1787847258.418223:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847258.418236:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861a76 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.418472:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861a76 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.418483:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a76 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.418490:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a800, rc 0) 00000100:00100000:2.0:1787847258.418525:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320128:12345-0@lo:101: Request processed in 316us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.418531:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787847258.418617:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320128:0@lo:101: 00010000:00010000:3.0:1787847258.418631:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.418639:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847258.418737:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320256:0@lo:501: 00000100:00100000:3.0:1787847258.418763:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.418829:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.421664:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320256 00000100:00100000:1.0:1787847258.421680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320256 00000100:00100000:1.0:1787847258.421787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787847258.421799:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320256:12345-0@lo:501: 00000100:00100000:1.0:1787847258.422182:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320256:12345-0@lo:501: Request processed in 385us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.422189:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787847258.423869:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320256:0@lo:501: 00000100:00100000:3.0:1787847258.423972:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320384:0@lo:503: 00000100:00100000:3.0:1787847258.424053:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.424092:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.424186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320384 00000100:00100000:1.0:1787847258.424194:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320384 00000100:00100000:1.0:1787847258.424235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787847258.424244:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320384:12345-0@lo:503: 00000100:00100000:1.0:1787847258.424879:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320384:12345-0@lo:503: Request processed in 633us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.424887:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787847258.425115:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320384:0@lo:503: 00000040:00080000:3.0:1787847258.425698:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787847258.425782:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320512:0@lo:502: 00000100:00100000:3.0:1787847258.425829:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.425879:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.427128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320512 00000100:00100000:1.0:1787847258.427141:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320512 00000100:00100000:1.0:1787847258.427231:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787847258.427241:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320512:12345-0@lo:502: 00000100:00100000:1.0:1787847258.428747:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320512:12345-0@lo:502: Request processed in 1502us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.428759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787847258.428906:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320512:0@lo:502: 00000040:00080000:3.0:1787847258.429236:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787847258.429311:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787847258.429350:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320640:0@lo:502: 00000100:00100000:3.0:1787847258.429410:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.458181:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.461683:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320640 00000100:00100000:0.0:1787847258.461702:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320640 00000100:00100000:0.0:1787847258.461774:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787847258.461785:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320640:12345-0@lo:502: 00000100:00100000:0.0:1787847258.462124:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320640:12345-0@lo:502: Request processed in 340us (32713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.462141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787847258.462502:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320640:0@lo:502: 00000040:00080000:3.0:1787847258.462753:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787847258.462770:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787847258.464110:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847258.464120:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847258.464122:0:7627:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787847258.464130:0:7627:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87ff957000 00000020:00000080:2.0:1787847258.464133:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787847258.464149:0:7627:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847258.464151:0:7627:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847258.464152:0:7627:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787847258.464155:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787847258.464457:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787847258.464481:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847258.464505:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.464517:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847258.464554:0:7616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787847258.464557:0:7616:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d87ff957000 10000000:01000000:3.0:1787847258.464560:0:7616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d87ff957000 10000000:01000000:3.0:1787847258.464564:0:7616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787847258.464570:0:7616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87ff957000 from 1 10000000:01000000:3.0:1787847258.464573:0:7616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847258.464701:0:7616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.464710:0:7616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.464720:0:7616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847258.464759:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320768:0@lo:101: 00000100:00100000:3.0:1787847258.464824:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.464872:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.464924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320768 00000100:00100000:0.0:1787847258.464963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320768 00000100:00100000:0.0:1787847258.465012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787847258.465021:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616320768:12345-0@lo:101: 00010000:00010000:0.0:1787847258.465035:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847258.465048:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861a84 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.465069:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861a84 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.465079:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a84 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847258.465088:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c0031600, rc 0) 00000100:00100000:0.0:1787847258.465126:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616320768:12345-0@lo:101: Request processed in 106us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.465133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787847258.465458:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320768:0@lo:101: 00010000:00010000:3.0:1787847258.465473:0:7616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847258.465481:0:7616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847258.465571:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320896:0@lo:501: 00000100:00100000:3.0:1787847258.465650:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.465677:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.465721:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616320896 00000100:00100000:2.0:1787847258.465732:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616320896 00000100:00100000:2.0:1787847258.465762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787847258.465768:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616320896:12345-0@lo:501: 00000100:00100000:2.0:1787847258.466056:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616320896:12345-0@lo:501: Request processed in 288us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.466062:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787847258.466214:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616320896:0@lo:501: 00000100:00100000:3.0:1787847258.466240:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321024:0@lo:503: 00000100:00100000:3.0:1787847258.466403:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.466430:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.472162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321024 00000100:00100000:2.0:1787847258.472178:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321024 00000100:00100000:2.0:1787847258.472235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787847258.472247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321024:12345-0@lo:503: 00000100:00100000:2.0:1787847258.472715:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321024:12345-0@lo:503: Request processed in 470us (6309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.472724:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787847258.473442:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321024:0@lo:503: 00000040:00080000:3.0:1787847258.473813:0:7616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787847258.473907:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321152:0@lo:502: 00000100:00100000:3.0:1787847258.474048:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.474089:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847258.474408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321152 00000100:00100000:0.0:1787847258.474415:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321152 00000100:00100000:0.0:1787847258.474458:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787847258.474467:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321152:12345-0@lo:502: 00000100:00100000:0.0:1787847258.474695:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321152:12345-0@lo:502: Request processed in 229us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.474703:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787847258.474796:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321152:0@lo:502: 00000040:00080000:3.0:1787847258.475092:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787847258.475146:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787847258.475176:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787847258.475218:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787847258.479441:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787847258.479632:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787847258.479672:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787847258.479707:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787847258.479769:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787847258.479808:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787847258.479866:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787847258.479919:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787847258.479978:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787847258.480010:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787847258.480055:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787847258.480094:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787847258.480128:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787847258.480176:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787847258.480233:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787847258.487494:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787847258.487609:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787847258.487665:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787847258.487700:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787847258.487746:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787847258.487780:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787847258.487812:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787847258.487872:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787847258.487910:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787847258.488383:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787847258.488445:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787847258.488482:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787847258.488519:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787847258.488557:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787847258.488607:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787847258.488643:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787847258.488706:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787847258.488744:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787847258.488808:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321280:0@lo:502: 00000100:00100000:0.0:1787847258.488901:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847258.494058:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6f08a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.504423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321280 00000100:00100000:2.0:1787847258.504439:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321280 00000100:00100000:3.0:1787847258.504562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787847258.504573:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321280:12345-0@lo:502: 00000100:00100000:3.0:1787847258.504910:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321280:12345-0@lo:502: Request processed in 337us (16008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847258.504918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787847258.505090:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321280:0@lo:502: 00000040:00080000:1.0:1787847258.505220:0:7616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787847258.505239:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787847258.505888:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787847258.505904:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d88008619d0) 00000020:00000080:3.0:1787847258.505924:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787847258.506067:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87ff957000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787847258.506071:0:7628:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87ff957000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787847258.506074:0:7628:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87ff957000 3 00010000:00080000:3.0:1787847258.506103:0:7628:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d86c18b1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.121@tcp at head 00010000:00010000:3.0:1787847258.507669:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787847258.507877:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787847258.507916:0:7628:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787847258.507962:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1835de88b9861a99 00000100:00080000:3.0:1787847258.507972:0:7628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787847258.507977:0:7628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d86c18b1000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847258.508013:0:7628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d87e12be1c0 x1874693616321408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787847258.508049:0:7628:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787847258.508159:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616321536:0@lo:400: 00000100:00100000:3.0:1787847258.508226:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.508267:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847258.508273:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616321664:0@lo:400: 00000100:00100000:3.0:1787847258.508293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.508332:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616321792:0@lo:400: 00000100:00100000:3.0:1787847258.508369:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847258.508414:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321536 00000100:00100000:3.0:1787847258.508420:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321536 00000100:00100000:3.0:1787847258.508454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321664 00000100:00100000:3.0:1787847258.508457:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321664 00000100:00100000:3.0:1787847258.508484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787847258.508491:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616321536:12345-0@lo:400: 00000100:00100000:3.0:1787847258.508534:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616321536:12345-0@lo:400: Request processed in 44us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847258.508541:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787847258.508552:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787847258.508557:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616321664:12345-0@lo:400: 00000100:00100000:3.0:1787847258.508579:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616321664:12345-0@lo:400: Request processed in 22us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847258.508590:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787847258.508616:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321792 00000100:00100000:3.0:1787847258.508619:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321792 00000100:00100000:3.0:1787847258.508644:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847258.508650:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616321792:12345-0@lo:400: 00000100:00100000:3.0:1787847258.508684:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616321792:12345-0@lo:400: Request processed in 35us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847258.508689:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787847258.508707:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787847258.508711:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787847258.508737:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12bda40 x1874693616321792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847258.508751:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616321792:0@lo:400: 00010000:00080000:3.0:1787847258.508777:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12bd680 x1874693616321664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847258.508785:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616321664:0@lo:400: 00010000:00080000:3.0:1787847258.508794:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12bcf00 x1874693616321536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847258.508802:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616321536:0@lo:400: 00000100:00100000:1.0:1787847258.510811:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616321408:0@lo:38: 00000100:00100000:1.0:1787847258.510893:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847258.516280:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321408 00000100:00100000:0.0:1787847258.516292:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321408 00000100:00100000:0.0:1787847258.516343:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787847258.516351:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1874693616321408:12345-0@lo:38: 00010000:00080000:0.0:1787847258.516395:0:5845:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1787847258.516432:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1835de88b9861aa0 00000004:00100000:0.0:1787847258.516447:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787847258.516482:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8d8800755000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787847258.516574:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1363c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874693616321408:12345-0@lo:38: Request processed in 221us (5681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847258.516582:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787847258.520351:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d87e12be1c0 x1874693616321408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787847268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847258.520366:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787847258.520376:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787847258.520384:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787847258.520390:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787847258.520393:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d86c18b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787847258.520399:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616321408:0@lo:38: 00000040:00080000:3.0:1787847258.526660:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787847258.526870:0:7616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787847258.526905:0:7616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787847258.526974:0:7616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.526986:0:7616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787847258.527030:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787847258.527032:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847258.527033:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847258.527034:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847258.527035:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847258.527036:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847258.527038:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847258.527040:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847258.527041:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847258.527043:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847258.527044:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787847258.527048:0:7616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787847258.527051:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787847258.527052:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847258.527053:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847258.527054:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847258.527055:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847258.527057:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847258.527057:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847258.527058:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847258.527059:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847258.527060:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847258.527061:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787847258.527084:0:7616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787847258.527103:0:7616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321920:0@lo:253: 00000100:00100000:1.0:1787847258.527170:0:7616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.527204:0:7616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7a18240 going to sleep for 11 seconds 00000100:00100000:2.0:1787847258.527322:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1874693616322048:0@lo:901: 00000100:00100000:2.0:1787847258.527356:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.527382:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c60e1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.527477:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322048 00000100:00100000:1.0:1787847258.527483:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322048 00000100:00100000:1.0:1787847258.527537:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847258.527551:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1874693616322048:12345-0@lo:901: 00000100:00100000:1.0:1787847258.527991:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7630:x1874693616322048:12345-0@lo:901: Request processed in 439us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.528000:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787847258.528634:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787847258.528669:0:7630:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d880036b0c0 x1874693616322048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787847274 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847258.528683:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7630:1874693616322048:0@lo:901: 00000100:00100000:3.0:1787847258.529054:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616321920 00000100:00100000:3.0:1787847258.529060:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616321920 00000100:00100000:3.0:1787847258.529111:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787847258.529119:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7616:x1874693616321920:12345-0@lo:253: 20000000:01000000:3.0:1787847258.529142:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787847258.529168:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1787847258.587690:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1787847258.658536:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787847258.658564:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787847258.659878:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787847258.659886:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787847258.659908:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.659976:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b98619e3 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.659985:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.660027:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b98619e3 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.660042:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b98619e3 expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847258.660058:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1874693616322176:0@lo:104: 00000100:00100000:2.0:1787847258.660119:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847258.660164:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787847258.660225:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322176 00000100:00100000:1.0:1787847258.660232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322176 00000100:00100000:1.0:1787847258.660294:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847258.660302:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5859:x1874693616322176:12345-0@lo:104: 00010000:00010000:1.0:1787847258.660313:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660360:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787847258.660365:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:5859:x1874693616322176:12345-0@lo:104: Request processed in 64us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.660372:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1787847258.660401:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847258.660407:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660414:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847258.660417:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660425:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847258.660432:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847258.660445:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787847258.660472:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660478:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847258.660495:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660502:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152a400/0x1835de88b98619e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619ea expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660516:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847258.660517:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847258.660519:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847258.660535:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616322304:0@lo:103: 00000100:00100000:1.0:1787847258.660564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847258.660595:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322304 00000100:00100000:1.0:1787847258.660598:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322304 00010000:00010000:1.0:1787847258.660612:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619e3 expref: 15 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847258.660628:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847258.660634:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:3301:x1874693616322304:12345-0@lo:103: 00010000:00010000:1.0:1787847258.660643:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847258.660647:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b98619e3 expref: 15 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660657:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b98619e3 expref: 15 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660676:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660684:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787847258.660695:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001829445s 00010000:00010000:1.0:1787847258.660699:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660706:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660713:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660720:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660725:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847258.660728:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660735:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660743:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847258.660750:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847258.660776:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:3301:x1874693616322304:12345-0@lo:103: Request processed in 142us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847258.660788:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847258.660848:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616322304:0@lo:103: 00010000:00010000:2.0:1787847258.661409:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a000/0x1835de88b98619ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b98619e3 expref: 14 pid: 5837 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847258.661421:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1874693616322176:0@lo:104: 00010000:00010000:2.0:1787847258.661434:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.661443:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.661448:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847258.661454:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b200/0x1835de88b9861aa7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847258.670883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:7616:x1874693616321920:12345-0@lo:253: Request processed in 141756us (143703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847258.670897:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787847258.671027:0:7616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:419007c4-9cf4-45fe-a98f-f6eaa183effb:7616:1874693616321920:0@lo:253: 10000000:01000000:1.0:1787847258.671041:0:7616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787847258.671044:0:7616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787847258.671045:0:7616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847258.671046:0:7616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847258.671047:0:7616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847258.671048:0:7616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847258.671050:0:7616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847258.671051:0:7616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847258.671052:0:7616:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787847258.671054:0:7616:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787847258.671055:0:7616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847258.671057:0:7616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787847258.671083:0:7616:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787847258.685812:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847258.686145:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787847258.687785:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787847258.690747:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787847258.691848:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787847258.692511:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787847258.694025:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787847258.991241:0:7616:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787847258.991249:0:7616:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787847258.991480:0:7616:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787847258.991544:0:7616:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787847258.991560:0:7616:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787847258.991588:0:7616:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787847259.612676:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847260.247197:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847260.275007:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616322432:0@lo:13: 00000100:00100000:2.0:1787847260.275094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847260.275204:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322432 00000100:00100000:3.0:1787847260.275213:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322432 00000100:00100000:3.0:1787847260.275293:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847260.275304:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616322432:12345-0@lo:13: 00002000:00000024:3.0:1787847260.275344:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847260.275401:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616322432:12345-0@lo:13: Request processed in 99us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847260.275408:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787847260.275636:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787847260.275670:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab0c0 x1874693616322432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847260.275694:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616322432:0@lo:13: 00010000:00010000:1.0:1787847260.631150:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847261.655127:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847262.679400:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847263.703585:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847263.832040:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616322560:0@lo:400: 00000100:00100000:3.0:1787847263.832116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847263.832162:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616323072:0@lo:400: 00000100:00100000:3.0:1787847263.832191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847263.832219:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847263.832225:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616322944:0@lo:400: 00000100:00100000:3.0:1787847263.832248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847263.832275:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323072 00000100:00100000:3.0:1787847263.832282:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323072 00000100:00100000:3.0:1787847263.832337:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787847263.832347:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616323072:12345-0@lo:400: 00000100:00100000:3.0:1787847263.832399:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616323072:12345-0@lo:400: Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847263.832406:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787847263.832428:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787847263.832460:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007abc00 x1874693616323072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847263.832474:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616323072:0@lo:400: 00000100:00100000:1.0:1787847263.832830:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616322688:0@lo:400: 00000100:00100000:1.0:1787847263.832864:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847263.832882:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787847263.832888:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616322816:0@lo:400: 00000100:00100000:1.0:1787847263.832905:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847263.832948:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322944 00000100:00100000:1.0:1787847263.832953:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322944 00000100:00100000:1.0:1787847263.832988:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847263.832996:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616322944:12345-0@lo:400: 00000100:00100000:1.0:1787847263.833042:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616322944:12345-0@lo:400: Request processed in 47us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847263.833049:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847263.833069:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322688 00000100:00100000:1.0:1787847263.833072:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322688 00000100:00100000:1.0:1787847263.833092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322816 00000100:00100000:1.0:1787847263.833095:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322816 00000100:00100000:1.0:1787847263.833113:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847263.833120:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616322688:12345-0@lo:400: 00000100:00100000:1.0:1787847263.833151:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616322688:12345-0@lo:400: Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847263.833157:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847263.833167:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787847263.833172:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616322816:12345-0@lo:400: 00000100:00100000:1.0:1787847263.833196:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616322816:12345-0@lo:400: Request processed in 24us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847263.833202:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787847263.833219:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787847263.833222:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787847263.833245:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab480 x1874693616322816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847263.833255:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616322816:0@lo:400: 00010000:00080000:1.0:1787847263.833264:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a8780 x1874693616322688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847263.833272:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616322688:0@lo:400: 00010000:00080000:1.0:1787847263.833298:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a9e00 x1874693616322944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847263.833314:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616322944:0@lo:400: 00000100:00100000:0.0:1787847263.834085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616322560 00000100:00100000:0.0:1787847263.834092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616322560 00000100:00100000:0.0:1787847263.834134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787847263.834141:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3303:x1874693616322560:12345-0@lo:400: 00000100:00100000:0.0:1787847263.834198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3303:x1874693616322560:12345-0@lo:400: Request processed in 58us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847263.834205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787847263.835009:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616322560:0@lo:400: 00010000:00010000:1.0:1787847264.728782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847265.376319:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847265.376346:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616323200:0@lo:13: 00000100:00100000:0.0:1787847265.376414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847265.376513:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323200 00000100:00100000:3.0:1787847265.376521:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323200 00000100:00100000:3.0:1787847265.376583:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847265.376593:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616323200:12345-0@lo:13: 00002000:00000024:3.0:1787847265.376626:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847265.376669:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616323200:12345-0@lo:13: Request processed in 77us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847265.376676:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787847265.377191:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787847265.377226:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007abc00 x1874693616323200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847265.377247:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616323200:0@lo:13: 00010000:00010000:1.0:1787847265.753084:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847266.782141:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787847266.910532:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787847266.910551:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87ef8a4000 from 30 10000000:01000000:1.0:1787847266.910557:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787847266.910607:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847266.910618:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847266.910629:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847266.910655:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323328:0@lo:101: 00000100:00100000:1.0:1787847266.910739:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.910806:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e01d2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.910843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323328 00000100:00100000:3.0:1787847266.910851:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323328 00000100:00100000:3.0:1787847266.910920:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787847266.910959:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616323328:12345-0@lo:101: 00010000:00010000:3.0:1787847266.910972:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847266.910986:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861aae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.911009:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861aae expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.911020:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861aae expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.911029:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c29d1a00, rc 0) 00000100:00100000:3.0:1787847266.911067:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616323328:12345-0@lo:101: Request processed in 140us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.911074:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787847266.912877:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323328:0@lo:101: 00010000:00010000:1.0:1787847266.912904:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847266.912916:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847266.913023:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323456:0@lo:501: 00000100:00100000:1.0:1787847266.913090:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.913295:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323456 00000100:00100000:3.0:1787847266.913301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323456 00000100:00100000:3.0:1787847266.913363:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787847266.913372:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616323456:12345-0@lo:501: 00000100:00100000:3.0:1787847266.913749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616323456:12345-0@lo:501: Request processed in 376us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.913756:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787847266.913835:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e01d2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847266.913853:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323456:0@lo:501: 00000100:00100000:0.0:1787847266.913886:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323584:0@lo:503: 00000100:00100000:0.0:1787847266.913925:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847266.913983:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880012a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847266.914358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323584 00000100:00100000:1.0:1787847266.914363:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323584 00000100:00100000:1.0:1787847266.914397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787847266.914406:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616323584:12345-0@lo:503: 00000100:00100000:1.0:1787847266.914719:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616323584:12345-0@lo:503: Request processed in 303us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.914727:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787847266.914891:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323584:0@lo:503: 00000100:00100000:3.0:1787847266.917849:0:7910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7910:1874693616323712:0@lo:502: 00000100:00100000:3.0:1787847266.917972:0:7910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.918009:0:7910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0dde180 going to sleep for 11 seconds 00000100:00100000:1.0:1787847266.919389:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323712 00000100:00100000:1.0:1787847266.919402:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323712 00000100:00100000:1.0:1787847266.919466:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787847266.919476:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7910:x1874693616323712:12345-0@lo:502: 00000100:00100000:1.0:1787847266.919857:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7910:x1874693616323712:12345-0@lo:502: Request processed in 381us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.919864:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787847266.920090:0:7910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7910:1874693616323712:0@lo:502: 00000100:00100000:2.0:1787847266.920169:0:7910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7910:1874693616323840:0@lo:502: 00000100:00100000:2.0:1787847266.920213:0:7910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.920249:0:7910:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b000 going to sleep for 11 seconds 00000100:00100000:1.0:1787847266.921170:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323840 00000100:00100000:1.0:1787847266.921178:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323840 00000100:00100000:1.0:1787847266.921226:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787847266.921234:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7910:x1874693616323840:12345-0@lo:502: 00000100:00100000:1.0:1787847266.921475:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:7910:x1874693616323840:12345-0@lo:502: Request processed in 241us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.921482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787847266.921651:0:7910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7910:1874693616323840:0@lo:502: 00000040:00080000:0.0:1787847266.921682:0:7910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787847266.921957:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787847266.921981:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787847266.921990:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847266.922012:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847266.922022:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787847266.922024:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787847266.922027:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787847266.922055:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847266.922062:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847266.922070:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847266.922086:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1363840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323968:0@lo:101: 00000100:00100000:1.0:1787847266.922191:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.922226:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.922524:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616323968 00000100:00100000:2.0:1787847266.922528:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616323968 00000100:00100000:2.0:1787847266.922562:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787847266.922575:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616323968:12345-0@lo:101: 00010000:00010000:2.0:1787847266.922585:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847266.922602:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861abc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.922621:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861abc expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.922632:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861abc expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.922640:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847266.922679:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616323968:12345-0@lo:101: Request processed in 105us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847266.922685:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787847266.923683:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1363840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616323968:0@lo:101: 00010000:00010000:0.0:1787847266.923702:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847266.923723:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847266.923891:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324096:0@lo:501: 00000100:00100000:0.0:1787847266.923948:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847266.923977:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880012ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847266.923990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324096 00000100:00100000:0.0:1787847266.923995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324096 00000100:00100000:0.0:1787847266.924021:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787847266.924028:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616324096:12345-0@lo:501: 00000100:00100000:0.0:1787847266.924339:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616324096:12345-0@lo:501: Request processed in 310us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847266.924346:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787847266.924380:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324096:0@lo:501: 00000100:00100000:0.0:1787847266.924403:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324224:0@lo:503: 00000100:00100000:0.0:1787847266.924436:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847266.924448:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880012ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847266.924458:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324224 00000100:00100000:0.0:1787847266.924461:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324224 00000100:00100000:0.0:1787847266.924479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787847266.924484:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616324224:12345-0@lo:503: 00000100:00100000:0.0:1787847266.925024:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616324224:12345-0@lo:503: Request processed in 537us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847266.925041:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787847266.925157:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324224:0@lo:503: 00000100:00100000:1.0:1787847266.925566:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7911:1874693616324352:0@lo:502: 00000100:00100000:1.0:1787847266.925602:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.925633:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847266.925741:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324352 00000100:00100000:0.0:1787847266.925746:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324352 00000100:00100000:0.0:1787847266.925786:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787847266.925794:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:7911:x1874693616324352:12345-0@lo:502: 00000100:00100000:0.0:1787847266.925978:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:7911:x1874693616324352:12345-0@lo:502: Request processed in 185us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847266.925985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787847266.926404:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7911:1874693616324352:0@lo:502: 00000020:01000000:1.0:1787847266.926428:0:7911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787847266.926437:0:7911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787847266.926440:0:7911:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787847266.926444:0:7911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787847266.926453:0:7911:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787847266.926469:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7911:1874693616324480:0@lo:502: 00000100:00100000:1.0:1787847266.926501:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.926530:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847266.926634:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324480 00000100:00100000:0.0:1787847266.926639:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324480 00000100:00100000:0.0:1787847266.926664:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787847266.926670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:7911:x1874693616324480:12345-0@lo:502: 00000100:00100000:0.0:1787847266.926910:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:7911:x1874693616324480:12345-0@lo:502: Request processed in 239us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847266.926917:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787847266.929013:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7911:1874693616324480:0@lo:502: 00000020:01000000:0.0:1787847266.929066:0:7911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847266.929076:0:7911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847266.929078:0:7911:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787847266.929084:0:7911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1787847266.929277:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787847266.929298:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787847266.929308:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.929320:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847266.929331:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787847266.929333:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87d0568000 from 30 10000000:01000000:2.0:1787847266.929336:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787847266.929386:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.929395:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.929411:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847266.929431:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324608:0@lo:101: 00000100:00100000:2.0:1787847266.929490:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.929534:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.929635:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324608 00000100:00100000:3.0:1787847266.929642:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324608 00000100:00100000:3.0:1787847266.929685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787847266.929694:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616324608:12345-0@lo:101: 00010000:00010000:3.0:1787847266.929706:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847266.929729:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861aca expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.929753:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861aca expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.929763:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861aca expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.929772:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c29d1000, rc 0) 00000100:00100000:3.0:1787847266.929818:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616324608:12345-0@lo:101: Request processed in 125us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.929825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787847266.929927:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324608:0@lo:101: 00010000:00010000:2.0:1787847266.929963:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.929972:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847266.930020:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324736:0@lo:501: 00000100:00100000:2.0:1787847266.930043:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.930067:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.930179:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324736 00000100:00100000:3.0:1787847266.930184:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324736 00000100:00100000:3.0:1787847266.930221:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787847266.930227:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616324736:12345-0@lo:501: 00000100:00100000:3.0:1787847266.930567:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616324736:12345-0@lo:501: Request processed in 339us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.930574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787847266.930926:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324736:0@lo:501: 00000100:00100000:2.0:1787847266.930971:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324864:0@lo:503: 00000100:00100000:2.0:1787847266.931008:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.931040:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.931152:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324864 00000100:00100000:3.0:1787847266.931157:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324864 00000100:00100000:3.0:1787847266.931180:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787847266.931187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616324864:12345-0@lo:503: 00000100:00100000:3.0:1787847266.931336:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616324864:12345-0@lo:503: Request processed in 149us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.931358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787847266.931495:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616324864:0@lo:503: 00000100:00100000:2.0:1787847266.931652:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7912:1874693616324992:0@lo:502: 00000100:00100000:2.0:1787847266.931683:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.931701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616324992 00000100:00100000:2.0:1787847266.931721:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616324992 00000100:00100000:2.0:1787847266.931743:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787847266.931749:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:7912:x1874693616324992:12345-0@lo:502: 00000100:00100000:2.0:1787847266.931895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:7912:x1874693616324992:12345-0@lo:502: Request processed in 146us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847266.931985:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787847266.932018:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.932030:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7912:1874693616324992:0@lo:502: 00000100:00100000:2.0:1787847266.932068:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7912:1874693616325120:0@lo:502: 00000100:00100000:2.0:1787847266.932098:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.932121:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847266.932195:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325120 00000100:00100000:0.0:1787847266.932199:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325120 00000100:00100000:0.0:1787847266.932235:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787847266.932242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:7912:x1874693616325120:12345-0@lo:502: 00000100:00100000:0.0:1787847266.932372:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:7912:x1874693616325120:12345-0@lo:502: Request processed in 130us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847266.932379:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787847266.932667:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7912:1874693616325120:0@lo:502: 00000040:00080000:2.0:1787847266.932687:0:7912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787847266.932836:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787847266.932854:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787847266.932863:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.932874:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847266.932883:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787847266.932886:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87d0568000 from 5 10000000:01000000:3.0:1787847266.932888:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787847266.932923:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.932953:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.932974:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847266.932988:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325248:0@lo:101: 00000100:00100000:3.0:1787847266.933020:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.933039:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c13feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.933157:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325248 00000100:00100000:2.0:1787847266.933161:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325248 00000100:00100000:2.0:1787847266.933195:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787847266.933204:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616325248:12345-0@lo:101: 00010000:00010000:2.0:1787847266.933214:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847266.933228:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b200/0x1835de88b9861adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861ad8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.933247:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b200/0x1835de88b9861adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861ad8 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.933257:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b200/0x1835de88b9861adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861ad8 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.933264:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b200, rc 0) 00000100:00100000:2.0:1787847266.933307:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616325248:12345-0@lo:101: Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847266.933312:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787847266.933458:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325248:0@lo:101: 00010000:00010000:3.0:1787847266.933471:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.933479:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847266.933522:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325376:0@lo:256: 00000100:00100000:3.0:1787847266.933552:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.933604:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c13feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.936017:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325376 00000100:00100000:2.0:1787847266.936031:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325376 00000100:00100000:2.0:1787847266.936088:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787847266.936098:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616325376:12345-0@lo:256: 20000000:01000000:2.0:1787847266.936124:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787847266.936142:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787847266.936145:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787847266.936272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616325376:12345-0@lo:256: Request processed in 175us (2719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847266.936280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787847266.936382:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325376:0@lo:256: 10000000:01000000:3.0:1787847266.936436:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787847266.936445:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.936455:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847266.936465:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787847266.936468:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787847266.936476:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787847266.936504:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.936513:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.936521:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847266.936539:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325504:0@lo:101: 00000100:00100000:3.0:1787847266.936572:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.936595:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c13feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.936794:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325504 00000100:00100000:2.0:1787847266.936798:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325504 00000100:00100000:2.0:1787847266.936829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787847266.936837:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616325504:12345-0@lo:101: 00010000:00010000:2.0:1787847266.936845:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847266.936857:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861ae6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.936876:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.936886:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.936895:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847266.936921:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616325504:12345-0@lo:101: Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847266.936948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787847266.937016:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325504:0@lo:101: 00010000:00010000:3.0:1787847266.937029:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.937038:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847266.937081:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325632:0@lo:501: 00000100:00100000:3.0:1787847266.937105:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.937162:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c13feb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.937863:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325632 00000100:00100000:2.0:1787847266.937869:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325632 00000100:00100000:3.0:1787847266.940805:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787847266.940818:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616325632:12345-0@lo:501: 00000100:00100000:3.0:1787847266.941151:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616325632:12345-0@lo:501: Request processed in 334us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.941159:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787847266.941216:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325632:0@lo:501: 00000100:00100000:3.0:1787847266.941259:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325760:0@lo:503: 00000100:00100000:3.0:1787847266.941301:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.941328:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c13feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.941498:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325760 00000100:00100000:3.0:1787847266.941505:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325760 00000100:00100000:3.0:1787847266.941582:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787847266.941590:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616325760:12345-0@lo:503: 00000100:00100000:3.0:1787847266.941885:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616325760:12345-0@lo:503: Request processed in 295us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.941892:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787847266.941965:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616325760:0@lo:503: 00000100:00100000:2.0:1787847266.942133:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7913:1874693616325888:0@lo:502: 00000100:00100000:2.0:1787847266.942171:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847266.942619:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616325888 00000100:00100000:0.0:1787847266.942624:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616325888 00000100:00100000:0.0:1787847266.942647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787847266.942654:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:7913:x1874693616325888:12345-0@lo:502: 00000100:00100000:0.0:1787847266.942882:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:7913:x1874693616325888:12345-0@lo:502: Request processed in 228us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847266.942890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787847266.943494:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.943511:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7913:1874693616325888:0@lo:502: 00000020:01000000:3.0:1787847266.943537:0:7913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787847266.943544:0:7913:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787847266.943551:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847266.943553:0:7913:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787847266.943558:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787847266.943562:0:7913:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:3.0:1787847266.943582:0:7913:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787847266.943585:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847266.943598:0:7913:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d8800864d70) 00000020:00000080:3.0:1787847266.943617:0:7913:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787847266.943622:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787847266.943686:0:7913:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787847266.943692:0:7913:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787847266.943698:0:7913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9861afb 00010000:00080000:3.0:1787847266.944041:0:7913:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d88007a7800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:3.0:1787847266.944270:0:7913:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787847266.944683:0:7913:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787847266.944694:0:7913:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787847266.946799:0:7913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847266.947185:0:7913:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847266.947241:0:7913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787847266.947299:0:7913:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787847266.947810:0:7914:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847266.947816:0:7914:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787847266.948495:0:7913:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787847266.948507:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787847266.948540:0:7913:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787847266.948564:0:7913:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9861b02 00000100:00080000:3.0:1787847266.948574:0:7913:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787847266.948580:0:7913:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d88007a7800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847266.948614:0:7913:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d88007a9680 x1874693616326016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847266.960196:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616326016:0@lo:8: 00000100:00100000:2.0:1787847266.960291:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.960402:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326016 00000100:00100000:1.0:1787847266.960412:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326016 00000100:00100000:1.0:1787847266.960452:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847266.960460:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1874693616326016:12345-0@lo:8: 00010000:00080000:1.0:1787847266.960488:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1787847266.960515:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9861b09 00002000:00100000:1.0:1787847266.960527:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d87e7607000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113957 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787847266.960531:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787847266.960535:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787847266.960669:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787847266.960845:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787847266.960870:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d87e7601000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787847266.960961:0:7913:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787847266.961070:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616326144:0@lo:400: 00000100:00100000:3.0:1787847266.961103:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.961127:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787847266.961133:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616326528:0@lo:400: 00000100:00100000:3.0:1787847266.961155:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1787847266.961240:0:7913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847266.961246:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847266.961248:0:7913:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787847266.961252:0:7913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847266.961256:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847266.961257:0:7913:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787847266.961260:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787847266.961262:0:7913:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787847266.961284:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7913:1874693616326656:0@lo:502: 00000100:00100000:3.0:1787847266.961338:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.961361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326656 00000100:00100000:3.0:1787847266.961366:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326656 00000100:00100000:3.0:1787847266.961395:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787847266.961403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:7913:x1874693616326656:12345-0@lo:502: 00000100:00100000:3.0:1787847266.961621:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:7913:x1874693616326656:12345-0@lo:502: Request processed in 218us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847266.961629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787847266.961666:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787847266.961683:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:7913:1874693616326656:0@lo:502: 00000020:01000000:3.0:1787847266.961705:0:7913:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847266.961841:0:7913:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847266.961844:0:7913:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787847266.961848:0:7913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1787847266.976853:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874693616326016:12345-0@lo:8: Request processed in 16379us (16549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.976869:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847266.976947:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616326272:0@lo:400: 00000100:00100000:1.0:1787847266.977031:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.977082:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847266.977091:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616326400:0@lo:400: 00000100:00100000:1.0:1787847266.977118:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847266.977162:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326144 00000100:00100000:1.0:1787847266.977169:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326144 00000100:00100000:1.0:1787847266.977212:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326528 00000100:00100000:1.0:1787847266.977229:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326528 00000100:00100000:1.0:1787847266.977259:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326272 00000100:00100000:1.0:1787847266.977262:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326272 00000100:00100000:1.0:1787847266.977279:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847266.977286:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616326144:12345-0@lo:400: 00000100:00100000:1.0:1787847266.977342:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616326144:12345-0@lo:400: Request processed in 56us (16238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.977350:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847266.977364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787847266.977371:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616326528:12345-0@lo:400: 00000100:00100000:1.0:1787847266.977398:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616326528:12345-0@lo:400: Request processed in 28us (16242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.977404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787847266.977415:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787847266.977422:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616326272:12345-0@lo:400: 00000100:00100000:1.0:1787847266.977451:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616326272:12345-0@lo:400: Request processed in 30us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.977457:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787847266.977480:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326400 00000100:00100000:1.0:1787847266.977484:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326400 00000100:00100000:1.0:1787847266.977506:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847266.977512:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1362d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616326400:12345-0@lo:400: 00000100:00100000:1.0:1787847266.977541:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1362d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616326400:12345-0@lo:400: Request processed in 29us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847266.977547:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787847266.977564:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787847266.977593:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007aad00 x1874693616326528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847266.977614:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616326528:0@lo:400: 00010000:00080000:1.0:1787847266.977630:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a8000 x1874693616326144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847266.977638:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616326144:0@lo:400: 00010000:00080000:1.0:1787847266.977674:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007aa940 x1874693616326400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847266.977682:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616326400:0@lo:400: 00010000:00080000:1.0:1787847266.977691:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a92c0 x1874693616326272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847266.977698:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616326272:0@lo:400: 00000020:01000000:3.0:1787847266.978207:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787847266.978233:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787847266.978242:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.978253:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847266.978265:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787847266.978267:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d87c51c33a0 from 1 10000000:01000000:3.0:1787847266.978269:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787847266.978297:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.978304:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847266.978323:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847266.978339:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616326784:0@lo:101: 00000100:00100000:3.0:1787847266.978382:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847266.978409:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddf180 going to sleep for 11 seconds 00010000:00080000:2.0:1787847266.985805:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a9680 x1874693616326016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787847276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847266.985822:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787847266.985833:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787847266.985842:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787847266.985849:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787847266.985853:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d88007a7800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787847266.985881:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787847266.985888:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616326016:0@lo:8: 00000100:00100000:2.0:1787847266.985969:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326784 00000100:00100000:2.0:1787847266.985977:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326784 00000100:00100000:2.0:1787847266.986028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787847266.986038:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616326784:12345-0@lo:101: 00010000:00010000:2.0:1787847266.986053:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847266.986072:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861b10 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.986100:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861b10 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.986123:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861b10 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.986132:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152aa00, rc 0) 00000100:00100000:2.0:1787847266.986210:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616326784:12345-0@lo:101: Request processed in 173us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847266.986217:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787847266.986278:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616326784:0@lo:101: 00010000:00010000:2.0:1787847266.986296:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.986306:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847266.986381:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616326912:0@lo:501: 00000100:00100000:2.0:1787847266.986417:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847266.986437:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787847266.986450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616326912 00000100:00100000:2.0:1787847266.986454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616326912 00000100:00100000:2.0:1787847266.986475:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787847266.986482:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616326912:12345-0@lo:501: 00000100:00100000:2.0:1787847266.986744:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616326912:12345-0@lo:501: Request processed in 261us (326us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787847266.986752:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787847266.986781:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616326912:0@lo:501: 10000000:01000000:2.0:1787847266.986807:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787847266.986820:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847266.986828:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787847266.989231:0:7914:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787847266.989352:0:7914:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 181813419843ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787847267.076059:0:7915:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787847267.076086:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327168:0@lo:7: 00000100:00100000:0.0:1787847267.076165:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847267.076210:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880012a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847267.076509:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616327040:0@lo:13: 00000100:00100000:1.0:1787847267.076541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847267.076664:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327040 00000100:00100000:3.0:1787847267.076670:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327040 00000100:00100000:3.0:1787847267.076729:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847267.076738:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616327040:12345-0@lo:13: 00002000:00000024:3.0:1787847267.076769:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787847267.076812:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1362580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616327040:12345-0@lo:13: Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847267.076819:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847267.076863:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327168 00000100:00100000:1.0:1787847267.076867:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327168 00000100:00100000:1.0:1787847267.077002:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847267.077010:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7915:x1874693616327168:12345-0@lo:7: 00000100:00080000:0.0:1787847267.078202:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787847267.080048:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787847267.084559:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787847267.084573:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:0.0:1787847267.085367:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c75e00 x1874693616327040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847267.085395:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616327040:0@lo:13: 00002000:00080000:0.0:1787847267.097414:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787847267.097423:0:6678:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787847267.097533:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7915:x1874693616327168:12345-0@lo:7: Request processed in 20519us (21362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847267.097544:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787847267.097631:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c77c00 x1874693616327168/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787847283 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847267.097647:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327168:0@lo:7: 00000004:00080000:1.0:1787847267.097660:0:7915:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787847267.097699:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327296:0@lo:5: 00000100:00100000:1.0:1787847267.097745:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847267.097790:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6180 going to sleep for 11 seconds 00000100:00100000:0.0:1787847267.108880:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327296 00000100:00100000:0.0:1787847267.108895:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327296 00000100:00100000:0.0:1787847267.108985:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787847267.108996:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1363840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7915:x1874693616327296:12345-0@lo:5: 00002000:00080000:0.0:1787847267.109047:0:6679:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787847267.109050:0:6679:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787847267.109457:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1363840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7915:x1874693616327296:12345-0@lo:5: Request processed in 462us (11711us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787847267.109465:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787847267.109479:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e13630c0 x1874693616327296/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787847283 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847267.109500:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327296:0@lo:5: 00000004:00080000:1.0:1787847267.109513:0:7915:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787847267.109559:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327424:0@lo:700: 00000100:00100000:1.0:1787847267.109599:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847267.109628:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6180 going to sleep for 11 seconds 00000100:00100000:2.0:1787847267.110367:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327424 00000100:00100000:2.0:1787847267.110374:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327424 00000100:00100000:2.0:1787847267.110412:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847267.110420:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7915:x1874693616327424:12345-0@lo:700: 00000100:00100000:2.0:1787847267.110452:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874693616327552:0@lo:700: 00000100:00100000:2.0:1787847267.110483:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847267.110512:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c2d2bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847267.110812:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327552 00000100:00100000:3.0:1787847267.110817:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327552 00000100:00100000:3.0:1787847267.110854:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847267.110860:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88003683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874693616327552:12345-0@lo:700: 40000000:02000000:2.0:1787847267.235747:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1787847267.240830:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88003683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1874693616327552:12345-0@lo:700: Request processed in 129962us (130338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847267.240844:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787847267.242514:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800369a40 x1874693616327552/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787847283 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847267.242533:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1874693616327552:0@lo:700: 40000000:02000000:3.0:1787847267.242549:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787847267.418439:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787847267.418472:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787847267.420494:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1361a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7915:x1874693616327424:12345-0@lo:700: Request processed in 310067us (310886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847267.420508:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787847267.421533:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e1360000 x1874693616327424/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787847283 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847267.421547:0:7915:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787847267.421564:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327424:0@lo:700: 00000004:02000040:0.0:1787847267.494345:0:7915:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1787847267.501099:0:7915:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327680:0@lo:5: 00000100:00100000:1.0:1787847267.501188:0:7915:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847267.501249:0:7915:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787847267.501369:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327680 00000100:00100000:0.0:1787847267.501378:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327680 00000100:00100000:0.0:1787847267.501432:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787847267.501442:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:7915:x1874693616327680:12345-0@lo:5: 00002000:00080000:1.0:1787847267.531957:0:7920:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787847267.531980:0:7920:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1787847267.544587:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7915:x1874693616327680:12345-0@lo:5: Request processed in 43139us (43391us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787847267.544600:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787847267.544820:0:7915:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e1360000 x1874693616327680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787847283 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847267.544839:0:7915:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7915:1874693616327680:0@lo:5: 00000004:00080000:0.0:1787847267.544853:0:7915:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787847267.807530:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787847268.307083:0:7982:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787847268.823371:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847269.849596:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847270.488150:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787847270.488181:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d2170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616327808:0@lo:13: 00000100:00100000:1.0:1787847270.488275:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847270.491240:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327808 00000100:00100000:0.0:1787847270.491262:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327808 00000100:00100000:0.0:1787847270.491364:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787847270.491378:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616327808:12345-0@lo:13: 00002000:00000024:0.0:1787847270.491442:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847270.491713:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616327808:12345-0@lo:13: Request processed in 338us (3438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847270.491723:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787847270.491754:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787847270.492408:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d2170000 x1874693616327808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847270.492455:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d2170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616327808:0@lo:13: 00010000:00010000:1.0:1787847270.871393:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847271.895344:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847272.023287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616327936:0@lo:400: 00000100:00100000:1.0:1787847272.023414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847272.024189:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616328320:0@lo:400: 00000100:00100000:0.0:1787847272.024259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847272.024359:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616328064:0@lo:400: 00000100:00100000:2.0:1787847272.024412:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847272.024438:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847272.024444:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616328192:0@lo:400: 00000100:00100000:2.0:1787847272.024479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847272.024525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616327936 00000100:00100000:2.0:1787847272.024534:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616327936 00000100:00100000:2.0:1787847272.024589:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787847272.024599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616327936:12345-0@lo:400: 00000100:00100000:2.0:1787847272.024665:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616327936:12345-0@lo:400: Request processed in 67us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847272.024673:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787847272.025645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328064 00000100:00100000:1.0:1787847272.025653:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328064 00000100:00100000:1.0:1787847272.025701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328192 00000100:00100000:1.0:1787847272.025705:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328192 00000100:00100000:1.0:1787847272.025746:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787847272.025754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616328064:12345-0@lo:400: 00000100:00100000:1.0:1787847272.025825:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616328064:12345-0@lo:400: Request processed in 72us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847272.025832:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787847272.025847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787847272.025853:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616328192:12345-0@lo:400: 00000100:00100000:1.0:1787847272.025878:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616328192:12345-0@lo:400: Request processed in 25us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847272.025884:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787847272.025962:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab480 x1874693616328192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847272.025978:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616328192:0@lo:400: 00010000:00080000:1.0:1787847272.025990:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a8780 x1874693616328064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847272.025998:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616328064:0@lo:400: 00000100:00100000:1.0:1787847272.026044:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616328448:0@lo:400: 00000100:00100000:1.0:1787847272.026077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847272.026107:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616327936:0@lo:400: 00000100:00100000:1.0:1787847272.026129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328448 00000100:00100000:1.0:1787847272.026133:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328448 00000100:00100000:1.0:1787847272.026159:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787847272.026166:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616328448:12345-0@lo:400: 00000100:00100000:1.0:1787847272.026204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616328448:12345-0@lo:400: Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847272.026210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787847272.026235:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab0c0 x1874693616328448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847272.026243:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616328448:0@lo:400: 00000100:00100000:1.0:1787847272.026279:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328320 00000100:00100000:1.0:1787847272.026283:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328320 00000100:00100000:1.0:1787847272.026314:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847272.026321:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616328320:12345-0@lo:400: 00000100:00080000:2.0:1787847272.026430:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847272.026436:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847272.030790:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787847272.030820:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616328576:0@lo:400: 00000100:00100000:3.0:1787847272.030923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847272.031011:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328576 00000100:00100000:3.0:1787847272.031020:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328576 00000100:00100000:3.0:1787847272.031100:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787847272.031111:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616328576:12345-0@lo:400: 00000100:00100000:3.0:1787847272.031172:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616328576:12345-0@lo:400: Request processed in 63us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847272.031180:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787847272.031227:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab0c0 x1874693616328576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847272.031245:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616328576:0@lo:400: 00000100:00100000:1.0:1787847272.031663:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616328320:12345-0@lo:400: Request processed in 5339us (7401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847272.031672:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787847272.031897:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787847272.032323:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007aa580 x1874693616328320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847272.032339:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616328320:0@lo:400: 00000100:00100000:3.0:1787847272.543165:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616328704:0@lo:13: 00000100:00100000:3.0:1787847272.543265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847272.543522:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328704 00000100:00100000:3.0:1787847272.543532:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328704 00000100:00100000:3.0:1787847272.543591:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787847272.543603:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616328704:12345-0@lo:13: 00002000:00000024:3.0:1787847272.543664:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847272.543730:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616328704:12345-0@lo:13: Request processed in 128us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847272.543738:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787847272.547182:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c75e00 x1874693616328704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847272.547216:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c75e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616328704:0@lo:13: 00000001:00080000:2.0:1787847272.746952:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787847272.920086:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847273.955556:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847274.973784:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847275.610294:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787847275.610327:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616328832:0@lo:13: 00000100:00100000:1.0:1787847275.610406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847275.610486:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328832 00000100:00100000:1.0:1787847275.610511:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328832 00000100:00080000:2.0:1787847275.612447:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847275.612661:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847275.612676:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616328832:12345-0@lo:13: 00002000:00000024:1.0:1787847275.612720:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847275.612796:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616328832:12345-0@lo:13: Request processed in 127us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847275.612801:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787847275.612848:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f34780 x1874693616328832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847275.612868:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616328832:0@lo:13: 00010000:00010000:3.0:1787847275.992752:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847276.915046:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847276.915298:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595332992 00000100:00100000:2.0:1787847276.915312:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595332992 00000100:00100000:2.0:1787847276.915387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:2.0:1787847276.915403:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2343:x1874693595332992:12345-192.168.201.21@tcp:250: 00010000:00080000:2.0:1787847276.915442:0:5838:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 69bd20f9-b82b-4055-8d65-e297ac8f20aa@192.168.201.21@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1787847276.915485:0:5838:0:(genops.c:1385:class_connect()) connect: client 69bd20f9-b82b-4055-8d65-e297ac8f20aa, cookie 0x1835de88b9861b1e 00000100:00080000:2.0:1787847276.915669:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d87ff952800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847276.915762:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+5:2343:x1874693595332992:12345-192.168.201.21@tcp:250: Request processed in 363us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847276.915771:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:3.0:1787847276.923903:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847276.925324:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595332864 00000100:00100000:2.0:1787847276.925353:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595332864 00000100:00100000:2.0:1787847276.925452:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:2.0:1787847276.925464:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+5:5573:x1874693595332864:12345-192.168.201.21@tcp:101: 00010000:00010000:2.0:1787847276.925486:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847276.925511:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ae8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847276.925581:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847276.925600:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847276.925612:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ac00, rc 0) 00000100:00100000:2.0:1787847276.925703:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+6:5573:x1874693595332864:12345-192.168.201.21@tcp:101: Request processed in 240us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847276.925711:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:2.0:1787847276.936010:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847276.936322:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333120 00000100:00100000:0.0:1787847276.936336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333120 00000100:00100000:0.0:1787847276.936423:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:0.0:1787847276.936438:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+6:5573:x1874693595333120:12345-192.168.201.21@tcp:501: 00000100:00100000:0.0:1787847276.936865:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+6:5573:x1874693595333120:12345-192.168.201.21@tcp:501: Request processed in 431us (873us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787847276.936874:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:3.0:1787847276.944242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847276.950671:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333248 00000100:00100000:0.0:1787847276.950693:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333248 00000100:00100000:2.0:1787847276.950872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:2.0:1787847276.950891:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+6:5573:x1874693595333248:12345-192.168.201.21@tcp:101: 00010000:00010000:2.0:1787847276.950914:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847276.950980:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0aef expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847276.951029:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847276.951044:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847276.951056:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b800, rc 0) 00000100:00100000:2.0:1787847276.951139:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+7:5573:x1874693595333248:12345-192.168.201.21@tcp:101: Request processed in 254us (6910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847276.951149:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:3.0:1787847276.967725:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847276.967995:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333376 00000100:00100000:2.0:1787847276.968014:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333376 00000100:00100000:2.0:1787847276.968080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:2.0:1787847276.968092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+7:5573:x1874693595333376:12345-192.168.201.21@tcp:501: 00000100:00100000:2.0:1787847276.968480:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5573:x1874693595333376:12345-192.168.201.21@tcp:501: Request processed in 389us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847276.968490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:0.0:1787847276.974698:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847276.974979:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333504 00000100:00100000:2.0:1787847276.974992:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333504 00000100:00100000:2.0:1787847276.975073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:2.0:1787847276.975085:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5573:x1874693595333504:12345-192.168.201.21@tcp:503: 00000100:00100000:2.0:1787847276.975594:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5573:x1874693595333504:12345-192.168.201.21@tcp:503: Request processed in 510us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847276.975604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:3.0:1787847276.980665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847276.980758:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333632 00000100:00100000:0.0:1787847276.980772:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333632 00000100:00100000:0.0:1787847276.980853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:0.0:1787847276.980867:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5592:x1874693595333632:12345-192.168.201.21@tcp:502: 00000100:00100000:1.0:1787847277.007678:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5592:x1874693595333632:12345-192.168.201.21@tcp:502: Request processed in 26795us (27072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.007700:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 119 00010000:00010000:1.0:1787847277.017349:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847277.044740:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847277.046117:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333760 00000100:00100000:0.0:1787847277.046133:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333760 00000100:00100000:0.0:1787847277.046211:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:0.0:1787847277.046223:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5592:x1874693595333760:12345-192.168.201.21@tcp:502: 00000100:00100000:1.0:1787847277.049488:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5592:x1874693595333760:12345-192.168.201.21@tcp:502: Request processed in 3250us (4744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.049507:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:0.0:1787847277.054226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847277.054413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595333888 00000100:00100000:1.0:1787847277.054436:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595333888 00000100:00100000:1.0:1787847277.054510:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:1.0:1787847277.054522:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:5573:x1874693595333888:12345-192.168.201.21@tcp:101: 00010000:00010000:1.0:1787847277.054553:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847277.054578:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165c600/0x1835de88b9861b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b19 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847277.054628:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165c600/0x1835de88b9861b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b19 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847277.054669:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165c600/0x1835de88b9861b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b19 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847277.054683:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c600, rc 0) 00000100:00100000:1.0:1787847277.054774:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5573:x1874693595333888:12345-192.168.201.21@tcp:101: Request processed in 254us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.054783:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:2.0:1787847277.058628:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847277.058798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334016 00000100:00100000:1.0:1787847277.058811:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334016 00000100:00100000:1.0:1787847277.058877:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:1.0:1787847277.058888:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5573:x1874693595334016:12345-192.168.201.21@tcp:256: 20000000:01000000:1.0:1787847277.058925:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787847277.059181:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787847277.059188:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787847277.059192:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787847277.059195:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787847277.062812:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5573:x1874693595334016:12345-192.168.201.21@tcp:256: Request processed in 3908us (4180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.062831:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:0.0:1787847277.065364:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847277.065566:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334144 00000100:00100000:3.0:1787847277.065579:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334144 00000100:00100000:3.0:1787847277.065704:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:3.0:1787847277.065719:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5573:x1874693595334144:12345-192.168.201.21@tcp:101: 00010000:00010000:3.0:1787847277.065754:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847277.065777:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b20 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847277.065814:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847277.065826:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847277.065836:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7e00, rc 0) 00000100:00100000:3.0:1787847277.065916:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5573:x1874693595334144:12345-192.168.201.21@tcp:101: Request processed in 201us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847277.065923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:2.0:1787847277.067674:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847277.067827:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334272 00000100:00100000:1.0:1787847277.067839:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334272 00000100:00100000:1.0:1787847277.067969:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:1.0:1787847277.067982:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5573:x1874693595334272:12345-192.168.201.21@tcp:501: 00000100:00100000:1.0:1787847277.068341:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5573:x1874693595334272:12345-192.168.201.21@tcp:501: Request processed in 361us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.068349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:0.0:1787847277.070480:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847277.070600:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334400 00000100:00100000:3.0:1787847277.070610:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334400 00000100:00100000:3.0:1787847277.070667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:3.0:1787847277.070680:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5573:x1874693595334400:12345-192.168.201.21@tcp:503: 00000100:00100000:3.0:1787847277.071196:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5573:x1874693595334400:12345-192.168.201.21@tcp:503: Request processed in 516us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847277.071207:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:0.0:1787847277.077048:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847277.077641:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334528 00000100:00100000:1.0:1787847277.077654:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334528 00000100:00100000:1.0:1787847277.077729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:1.0:1787847277.077740:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5597:x1874693595334528:12345-192.168.201.21@tcp:502: 00000100:00100000:1.0:1787847277.078164:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5597:x1874693595334528:12345-192.168.201.21@tcp:502: Request processed in 424us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.078174:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:2.0:1787847277.080389:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847277.080526:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334656 00000100:00100000:3.0:1787847277.080547:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334656 00000100:00100000:3.0:1787847277.080610:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:3.0:1787847277.080621:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5597:x1874693595334656:12345-192.168.201.21@tcp:502: 00000100:00100000:3.0:1787847277.080920:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5597:x1874693595334656:12345-192.168.201.21@tcp:502: Request processed in 300us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847277.080929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:0.0:1787847277.090452:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847277.090692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334784 00000100:00100000:1.0:1787847277.090704:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334784 00000100:00100000:1.0:1787847277.090769:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1787847277.090779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2343:x1874693595334784:12345-192.168.201.21@tcp:38: 00010000:00080000:1.0:1787847277.090818:0:5843:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1787847277.090881:0:5843:0:(genops.c:1385:class_connect()) connect: client 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3, cookie 0x1835de88b9861b41 00000004:00100000:1.0:1787847277.090920:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787847277.090927:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787847277.136445:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d87c600b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847277.137357:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2343:x1874693595334784:12345-192.168.201.21@tcp:38: Request processed in 46571us (46911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.137372:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:3.0:1787847277.143402:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616329088:0@lo:400: 00000100:00100000:3.0:1787847277.143495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847277.143581:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616329600:0@lo:400: 00000100:00100000:3.0:1787847277.143609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847277.143642:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847277.143647:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616329216:0@lo:400: 00000100:00100000:3.0:1787847277.143666:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847277.143700:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329088 00000100:00100000:3.0:1787847277.143708:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329088 00000100:00100000:3.0:1787847277.143754:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329216 00000100:00100000:3.0:1787847277.143757:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329216 00000100:00100000:3.0:1787847277.143785:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787847277.143794:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616329088:12345-0@lo:400: 00000100:00100000:1.0:1787847277.144997:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616328960:0@lo:400: 00000100:00100000:1.0:1787847277.145061:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847277.145101:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616329472:0@lo:400: 00000100:00100000:1.0:1787847277.145124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847277.145140:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787847277.145146:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616329344:0@lo:400: 00000100:00100000:1.0:1787847277.145168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847277.145219:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616328960 00000100:00100000:1.0:1787847277.145224:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616328960 00000100:00100000:1.0:1787847277.145262:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787847277.145271:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616328960:12345-0@lo:400: 00000100:00100000:1.0:1787847277.145313:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616328960:12345-0@lo:400: Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.145321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787847277.145374:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616328960:0@lo:400: 00000100:00100000:2.0:1787847277.145754:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329600 00000100:00100000:2.0:1787847277.145759:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329600 00000100:00100000:2.0:1787847277.145811:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329344 00000100:00100000:2.0:1787847277.145814:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329344 00000100:00100000:2.0:1787847277.145843:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847277.145926:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616329600:12345-0@lo:400: 00000100:00100000:2.0:1787847277.146007:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616329600:12345-0@lo:400: Request processed in 157us (2397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847277.146014:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847277.146029:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787847277.146043:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616329344:12345-0@lo:400: 00000100:00100000:2.0:1787847277.146087:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616329344:12345-0@lo:400: Request processed in 45us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847277.146093:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787847277.146117:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329472 00000100:00100000:2.0:1787847277.146120:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329472 00000100:00100000:2.0:1787847277.146139:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787847277.146145:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616329216:12345-0@lo:400: 00000100:00100000:2.0:1787847277.146174:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616329216:12345-0@lo:400: Request processed in 29us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847277.146179:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787847277.146190:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787847277.146210:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616329472:12345-0@lo:400: 00000100:00100000:2.0:1787847277.146234:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616329472:12345-0@lo:400: Request processed in 39us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847277.146239:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787847277.146258:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847277.146262:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847277.146265:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787847277.146390:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a9680 x1874693616329344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847277.146405:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616329344:0@lo:400: 00010000:00080000:2.0:1787847277.146415:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a92c0 x1874693616329472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847277.146424:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616329472:0@lo:400: 00010000:00080000:2.0:1787847277.146718:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007abc00 x1874693616329216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847277.146737:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616329216:0@lo:400: 00010000:00080000:2.0:1787847277.146751:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab480 x1874693616329088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847277.146760:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616329088:0@lo:400: 00010000:00080000:2.0:1787847277.146771:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007aa940 x1874693616329600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847277.146779:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787847277.146789:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616329600:0@lo:400: 00000100:00100000:3.0:1787847277.146836:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616329088:12345-0@lo:400: Request processed in 54us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847277.146847:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787847277.664460:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847277.664495:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616329728:0@lo:13: 00000100:00100000:2.0:1787847277.664593:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847277.664754:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329728 00000100:00100000:1.0:1787847277.664764:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329728 00000100:00100000:1.0:1787847277.664833:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847277.665097:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616329728:12345-0@lo:13: 00002000:00000024:1.0:1787847277.665142:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847277.665202:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616329728:12345-0@lo:13: Request processed in 360us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847277.665210:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787847277.665359:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c75680 x1874693616329728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847277.665380:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616329728:0@lo:13: 00010000:00010000:3.0:1787847278.039547:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847278.147409:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847278.147553:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847278.159410:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335040 00000100:00100000:2.0:1787847278.159430:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335040 00000100:00100000:2.0:1787847278.159537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595334912 00000100:00100000:2.0:1787847278.159541:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595334912 00000100:00080000:3.0:1787847278.159578:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847278.159579:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:2.0:1787847278.159599:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:5573:x1874693595335040:12345-192.168.201.21@tcp:41: 00000100:00100000:3.0:1787847278.159635:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1787847278.159660:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:0:x1874693595334912:12345-192.168.201.21@tcp:41: 00000004:00000024:2.0:1787847278.159673:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000004:00000024:3.0:1787847278.159695:0:7214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787847278.161740:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:5573:x1874693595335040:12345-192.168.201.21@tcp:41: Request processed in 2132us (14332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847278.161755:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1787847278.169742:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:0:x1874693595334912:12345-192.168.201.21@tcp:41: Request processed in 10083us (22175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847278.169758:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:0.0:1787847278.173975:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847278.174288:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335168 00000100:00100000:2.0:1787847278.174301:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335168 00000100:00100000:2.0:1787847278.174376:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1787847278.174386:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5573:x1874693595335168:12345-192.168.201.21@tcp:40: 00000100:00100000:2.0:1787847278.174498:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5573:x1874693595335168:12345-192.168.201.21@tcp:40: Request processed in 113us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847278.174505:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1787847278.178140:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847278.181135:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335296 00000100:00100000:2.0:1787847278.181156:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335296 00000100:00100000:2.0:1787847278.181287:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1787847278.181297:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f37c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874693595335296:12345-192.168.201.21@tcp:8: 00010000:00080000:2.0:1787847278.181343:0:6677:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1787847278.181386:0:6677:0:(genops.c:1385:class_connect()) connect: client 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3, cookie 0x1835de88b9861b48 00002000:00100000:2.0:1787847278.181402:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3/ffff8d87ff951800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787847278.181433:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787847278.183039:0:6677:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787847278.183100:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8d87ff955000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847278.183223:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f37c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2343:x1874693595335296:12345-192.168.201.21@tcp:8: Request processed in 1923us (5094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847278.183235:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1787847278.206839:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847278.206887:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847278.206997:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847278.207463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335680 00000100:00100000:3.0:1787847278.207464:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335424 00000100:00100000:3.0:1787847278.207477:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335424 00000100:00100000:0.0:1787847278.207477:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335680 00000100:00100000:3.0:1787847278.207546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:0.0:1787847278.207546:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1787847278.207557:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595335424:12345-192.168.201.21@tcp:400: 00000100:00100000:0.0:1787847278.207557:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5573:x1874693595335680:12345-192.168.201.21@tcp:33: 00000100:00100000:3.0:1787847278.207645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595335424:12345-192.168.201.21@tcp:400: Request processed in 90us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847278.207653:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:2.0:1787847278.208490:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335552 00000100:00100000:2.0:1787847278.208501:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335552 00000100:00100000:2.0:1787847278.208555:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:2.0:1787847278.208563:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2343:x1874693595335552:12345-192.168.201.21@tcp:8: 00010000:00080000:2.0:1787847278.208601:0:7920:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:2.0:1787847278.208639:0:7920:0:(genops.c:1385:class_connect()) connect: client 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3, cookie 0x1835de88b9861b4f 00002000:00100000:2.0:1787847278.208682:0:7920:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3/ffff8d87ff957800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787847278.208697:0:7920:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787847278.209566:0:7920:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787847278.209608:0:7920:0:(import.c:65:import_set_state_nolock()) ffff8d87ff952000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847278.210634:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f34b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2343:x1874693595335552:12345-192.168.201.21@tcp:8: Request processed in 2063us (3738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847278.210649:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000004:00080000:3.0:1787847278.269038:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 61405us 00000004:00200000:3.0:1787847278.313717:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787847278.313909:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5573:x1874693595335680:12345-192.168.201.21@tcp:33: Request processed in 106348us (106905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847278.313963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:1.0:1787847278.622270:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847278.622374:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335808 00000100:00100000:2.0:1787847278.622383:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335808 00000100:00100000:2.0:1787847278.622448:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:2.0:1787847278.622458:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5615:x1874693595335808:12345-192.168.201.21@tcp:101: 00010000:00010000:2.0:1787847278.622478:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847278.622575:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152be00/0x1835de88b9861b56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b4a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847278.622658:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861b5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847278.622672:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847278.622685:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847278.622926:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787847278.622960:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847278.623041:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861b5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847278.623070:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152be00/0x1835de88b9861b56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b4a expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847278.623097:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861b5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b4a expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847278.623105:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7ff00) 00010000:00010000:2.0:1787847278.623108:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847278.623111:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:2.0:1787847278.623183:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:5615:x1874693595335808:12345-192.168.201.21@tcp:101: Request processed in 725us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847278.623190:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00010000:00010000:2.0:1787847279.063247:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847280.094356:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847280.727491:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847280.727530:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616329856:0@lo:13: 00000100:00100000:3.0:1787847280.727768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847280.729347:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329856 00000100:00100000:1.0:1787847280.729366:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329856 00000100:00100000:1.0:1787847280.729462:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787847280.729504:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616329856:12345-0@lo:13: 00000100:00080000:3.0:1787847280.729617:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787847280.730067:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847280.730189:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616329856:12345-0@lo:13: Request processed in 688us (2420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847280.730199:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787847280.730323:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f34f00 x1874693616329856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847280.730365:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616329856:0@lo:13: 00010000:00010000:1.0:1787847281.111657:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847281.515119:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847281.515196:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595335936 00000100:00100000:2.0:1787847281.515211:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595335936 00000100:00100000:2.0:1787847281.515311:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1787847281.515324:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:5667:x1874693595335936:12345-192.168.201.21@tcp:41: 00000004:00000024:2.0:1787847281.515386:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:3.0:1787847281.515962:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847281.516379:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:5667:x1874693595335936:12345-192.168.201.21@tcp:41: Request processed in 1052us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847281.516391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:0.0:1787847281.539576:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847281.539646:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336064 00000100:00100000:2.0:1787847281.539659:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336064 00000100:00100000:2.0:1787847281.539851:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1787847281.539875:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5667:x1874693595336064:12345-192.168.201.21@tcp:13: 00002000:00000024:2.0:1787847281.539912:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847281.540034:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5667:x1874693595336064:12345-192.168.201.21@tcp:13: Request processed in 172us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847281.540065:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00080000:3.0:1787847281.540288:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847281.543904:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847281.544086:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336192 00000100:00100000:2.0:1787847281.544098:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336192 00000100:00100000:2.0:1787847281.544193:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1787847281.544207:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5667:x1874693595336192:12345-192.168.201.21@tcp:13: 00002000:00000024:2.0:1787847281.544256:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847281.544340:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:5667:x1874693595336192:12345-192.168.201.21@tcp:13: Request processed in 136us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847281.544349:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00080000:3.0:1787847281.544626:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1787847281.941078:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00010000:00010000:3.0:1787847282.135430:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847282.268792:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616330368:0@lo:400: 00000100:00100000:2.0:1787847282.268881:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847282.268965:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787847282.268972:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616329984:0@lo:400: 00000100:00100000:2.0:1787847282.269001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847282.269022:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616330496:0@lo:400: 00000100:00100000:2.0:1787847282.269047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847282.269073:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616330112:0@lo:400: 00000100:00100000:2.0:1787847282.269094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847282.269110:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616330624:0@lo:400: 00000100:00100000:2.0:1787847282.269134:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847282.269151:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847282.269158:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616330240:0@lo:400: 00000100:00100000:2.0:1787847282.269181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847282.269231:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330368 00000100:00100000:2.0:1787847282.269239:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330368 00000100:00100000:2.0:1787847282.269302:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330624 00000100:00100000:2.0:1787847282.269306:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330624 00000100:00100000:2.0:1787847282.269338:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787847282.269347:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88003692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616330368:12345-0@lo:400: 00000100:00100000:2.0:1787847282.269403:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88003692c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616330368:12345-0@lo:400: Request processed in 57us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847282.269411:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787847282.269430:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787847282.269436:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616330624:12345-0@lo:400: 00000100:00100000:2.0:1787847282.269477:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616330624:12345-0@lo:400: Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847282.269483:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787847282.269501:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616329984 00000100:00100000:2.0:1787847282.269504:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616329984 00000100:00100000:2.0:1787847282.269527:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787847282.269532:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616329984:12345-0@lo:400: 00000100:00100000:2.0:1787847282.269556:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616329984:12345-0@lo:400: Request processed in 24us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847282.269562:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787847282.269589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330496 00000100:00100000:2.0:1787847282.269592:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330496 00000100:00100000:2.0:1787847282.269614:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330112 00000100:00100000:2.0:1787847282.269616:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330112 00000100:00100000:2.0:1787847282.269627:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330240 00000100:00100000:2.0:1787847282.269629:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330240 00000100:00100000:2.0:1787847282.269641:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787847282.269647:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616330496:12345-0@lo:400: 00000100:00100000:2.0:1787847282.269680:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616330496:12345-0@lo:400: Request processed in 33us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847282.269686:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787847282.269696:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787847282.269701:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616330112:12345-0@lo:400: 00000100:00100000:2.0:1787847282.269721:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616330112:12345-0@lo:400: Request processed in 20us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847282.269727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787847282.269735:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787847282.269740:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616330240:12345-0@lo:400: 00000100:00100000:2.0:1787847282.269759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616330240:12345-0@lo:400: Request processed in 19us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847282.269764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787847282.269788:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787847282.269792:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847282.269794:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847282.270171:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616330240:0@lo:400: 00000100:00100000:2.0:1787847282.270185:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616330112:0@lo:400: 00010000:00080000:2.0:1787847282.270199:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880036a940 x1874693616330624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847282.270209:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616330624:0@lo:400: 00000100:00100000:2.0:1787847282.270250:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616329984:0@lo:400: 00000100:00100000:2.0:1787847282.270262:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616330496:0@lo:400: 00010000:00080000:2.0:1787847282.270275:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880036ad00 x1874693616330368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847282.270294:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616330368:0@lo:400: 00000001:00100000:2.0:1787847282.346558:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000100:00100000:2.0:1787847282.777555:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616330752:0@lo:13: 00000100:00100000:2.0:1787847282.781547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847282.781639:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330752 00000100:00100000:3.0:1787847282.781652:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330752 00000100:00100000:3.0:1787847282.781731:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787847282.781744:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616330752:12345-0@lo:13: 00002000:00000024:3.0:1787847282.781777:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847282.783688:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616330752:12345-0@lo:13: Request processed in 1934us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847282.783706:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787847282.785249:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c743c0 x1874693616330752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847282.785280:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c743c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616330752:0@lo:13: 00000001:00100000:3.0:1787847282.870308:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00010000:00010000:0.0:1787847283.164316:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847283.632903:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847283.632999:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847283.633024:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847283.633062:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847283.633204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336448 00000100:00100000:3.0:1787847283.633217:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336448 00000100:00100000:3.0:1787847283.633303:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:3.0:1787847283.633316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595336448:12345-192.168.201.21@tcp:400: 00000100:00100000:3.0:1787847283.633426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595336448:12345-192.168.201.21@tcp:400: Request processed in 103us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847283.633436:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1787847283.633638:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336320 00000100:00100000:1.0:1787847283.633644:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336320 00000100:00100000:1.0:1787847283.633686:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00100000:1.0:1787847283.633694:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2345:x1874693595336320:12345-192.168.201.21@tcp:400: 00000100:00100000:1.0:1787847283.633734:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2345:x1874693595336320:12345-192.168.201.21@tcp:400: Request processed in 41us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847283.633740:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00080000:0.0:1787847283.633889:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847283.634104:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336576 00000100:00100000:2.0:1787847283.634109:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336576 00000100:00100000:2.0:1787847283.634163:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336704 00000100:00100000:2.0:1787847283.634167:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336704 00000100:00100000:2.0:1787847283.634200:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1787847283.634208:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595336576:12345-192.168.201.21@tcp:400: 00000100:00100000:2.0:1787847283.634247:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c743c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595336576:12345-192.168.201.21@tcp:400: Request processed in 40us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847283.634255:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1787847283.634268:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1787847283.634273:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595336704:12345-192.168.201.21@tcp:400: 00000100:00100000:2.0:1787847283.634298:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595336704:12345-192.168.201.21@tcp:400: Request processed in 25us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847283.634305:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00080000:0.0:1787847283.634487:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847283.634492:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787847284.183395:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787847284.664920:0:8286:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787847285.207626:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847285.856811:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616330880:0@lo:13: 00000100:00100000:3.0:1787847285.856926:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847285.857544:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616330880 00000100:00100000:1.0:1787847285.857555:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616330880 00000100:00100000:1.0:1787847285.857636:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847285.857648:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616330880:12345-0@lo:13: 00002000:00000024:1.0:1787847285.857697:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847285.857773:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616330880:12345-0@lo:13: Request processed in 128us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847285.857782:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787847285.857834:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d3c1a940 x1874693616330880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847285.857859:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616330880:0@lo:13: 00000100:00080000:3.0:1787847285.860020:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787847286.235160:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847287.255491:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847287.386594:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616331136:0@lo:400: 00000100:00100000:1.0:1787847287.386693:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847287.386793:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616331648:0@lo:400: 00000100:00100000:1.0:1787847287.386827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847287.386864:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787847287.386870:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616331264:0@lo:400: 00000100:00100000:1.0:1787847287.386915:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847287.387455:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616331392:0@lo:400: 00000100:00100000:2.0:1787847287.387497:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847287.387527:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787847287.387534:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616331008:0@lo:400: 00000100:00100000:2.0:1787847287.387568:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847287.387608:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616331520:0@lo:400: 00000100:00100000:2.0:1787847287.387635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847287.387678:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331136 00000100:00100000:2.0:1787847287.387689:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331136 00000100:00100000:2.0:1787847287.387749:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331264 00000100:00100000:2.0:1787847287.387753:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331264 00000100:00100000:2.0:1787847287.387784:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331520 00000100:00100000:2.0:1787847287.387787:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331520 00000100:00100000:2.0:1787847287.387808:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847287.387818:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616331136:12345-0@lo:400: 00000100:00100000:2.0:1787847287.387887:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616331136:12345-0@lo:400: Request processed in 70us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847287.387897:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847287.387920:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787847287.387927:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616331264:12345-0@lo:400: 00000100:00100000:2.0:1787847287.387989:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616331264:12345-0@lo:400: Request processed in 63us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847287.387996:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787847287.388010:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787847287.388031:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616331520:12345-0@lo:400: 00000100:00100000:2.0:1787847287.388080:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616331520:12345-0@lo:400: Request processed in 64us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847287.388086:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787847287.388368:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331648 00000100:00100000:2.0:1787847287.388373:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331648 00000100:00100000:2.0:1787847287.388405:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331392 00000100:00100000:2.0:1787847287.388408:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331392 00000100:00100000:2.0:1787847287.388431:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787847287.388447:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616331648:12345-0@lo:400: 00000100:00100000:2.0:1787847287.388484:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616331648:12345-0@lo:400: Request processed in 39us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847287.388491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787847287.388504:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787847287.388511:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616331392:12345-0@lo:400: 00000100:00100000:2.0:1787847287.388538:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616331392:12345-0@lo:400: Request processed in 28us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847287.388545:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787847287.388569:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331008 00000100:00100000:2.0:1787847287.388573:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331008 00000100:00100000:2.0:1787847287.388598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787847287.388605:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616331008:12345-0@lo:400: 00000100:00100000:2.0:1787847287.388637:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616331008:12345-0@lo:400: Request processed in 33us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847287.388644:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1787847287.388683:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847287.388689:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847287.388692:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847287.388725:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616331008:0@lo:400: 00000100:00100000:2.0:1787847287.388743:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616331520:0@lo:400: 00010000:00080000:2.0:1787847287.388760:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f36d00 x1874693616331392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847287.388773:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616331392:0@lo:400: 00000100:00100000:2.0:1787847287.388815:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616331264:0@lo:400: 00000100:00100000:2.0:1787847287.388841:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616331136:0@lo:400: 00010000:00080000:2.0:1787847287.388855:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f370c0 x1874693616331648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847287.388865:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616331648:0@lo:400: 00000100:00100000:0.0:1787847287.895161:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847287.895194:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616331776:0@lo:13: 00000100:00100000:0.0:1787847287.895290:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847287.895392:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616331776 00000100:00100000:0.0:1787847287.895422:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616331776 00000100:00100000:0.0:1787847287.895484:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787847287.895494:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616331776:12345-0@lo:13: 00002000:00000024:0.0:1787847287.895540:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847287.895594:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616331776:12345-0@lo:13: Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847287.895602:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787847287.895651:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c76580 x1874693616331776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847287.895672:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616331776:0@lo:13: 00010000:00010000:1.0:1787847288.287017:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787847288.338410:0:8435:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeec056810 20000000:00000080:2.0:1787847288.338435:0:8435:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d87efbf3000 uarg=0000000000000000 20000000:01000000:2.0:1787847288.338482:0:8435:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787847288.338485:0:8435:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787847288.338489:0:8435:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787847288.338495:0:8435:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787847288.338501:0:8435:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787847288.338518:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787847288.338520:0:8435:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787847288.339155:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787847288.339159:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787847288.340244:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787847288.341525:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787847288.341589:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787847288.341844:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1787847288.341868:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787847288.341871:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787847288.343294:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787847288.343879:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787847288.344456:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787847288.344505:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787847288.344521:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787847288.344525:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787847288.345909:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787847288.346572:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787847288.346631:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787847288.346663:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787847288.346674:0:8435:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787847288.346677:0:8435:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787847288.356600:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787847288.357689:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787847288.357978:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787847288.358040:0:8435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:0.0:1787847288.358062:0:8435:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787847288.358088:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358109:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a5a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358129:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a84 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358544:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861aae expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358552:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861abc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358559:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861aca expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358566:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358573:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861b10 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358585:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358592:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358603:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358658:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358689:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 9 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.358710:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c76580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616331904:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847288.358917:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358926:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 9 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.358954:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332032:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847288.358983:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861b10 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.358991:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861b10 expref: 18 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359000:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332160:0@lo:104: 00000100:00100000:0.0:1787847288.359046:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787847288.359096:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.359105:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 18 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359112:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332288:0@lo:104: 00000100:00100000:0.0:1787847288.359144:0:8435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787847288.359171:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861aca expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.359178:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861aca expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359184:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332416:0@lo:104: 00010000:00010000:0.0:1787847288.359221:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861abc expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.359228:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861abc expref: 18 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359235:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332544:0@lo:104: 00010000:00010000:0.0:1787847288.359258:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861aae expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.359264:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861aae expref: 18 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359271:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332672:0@lo:104: 00010000:00010000:0.0:1787847288.359288:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861a84 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.359294:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861a84 expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359299:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332800:0@lo:104: 00010000:00010000:0.0:1787847288.359316:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861a5a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.359331:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861a5a expref: 18 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.359464:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332928:0@lo:104: 00000100:00100000:0.0:1787847288.359484:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847288.360015:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787847288.360041:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847288.360055:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847288.360063:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847288.360071:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847288.360079:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847288.360087:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332160 00000100:00100000:1.0:1787847288.360095:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332160 00000100:00100000:1.0:1787847288.360150:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332288 00000100:00100000:1.0:1787847288.360154:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332288 00000100:00100000:1.0:1787847288.360164:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332416 00000100:00100000:1.0:1787847288.360166:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332416 00000100:00100000:1.0:1787847288.360174:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332544 00000100:00100000:1.0:1787847288.360177:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332544 00000100:00100000:1.0:1787847288.360185:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332672 00000100:00100000:1.0:1787847288.360187:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332672 00000100:00100000:1.0:1787847288.360197:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332800 00000100:00100000:1.0:1787847288.360199:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332800 00000100:00100000:1.0:1787847288.360209:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616332928 00000100:00100000:1.0:1787847288.360211:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616332928 00000100:00100000:1.0:1787847288.360224:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847288.360233:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:8435:x1874693616332160:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360250:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360326:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787847288.360349:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:8435:x1874693616332160:12345-0@lo:104: Request processed in 117us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360357:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847288.360388:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787847288.360394:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8251450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+8:8435:x1874693616332288:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360402:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360441:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787847288.360447:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8251450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+8:8435:x1874693616332288:12345-0@lo:104: Request processed in 53us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360453:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787847288.360497:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847288.360503:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+7:8435:x1874693616332416:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360510:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360543:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787847288.360548:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+7:8435:x1874693616332416:12345-0@lo:104: Request processed in 46us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360555:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847288.360567:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787847288.360573:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:8435:x1874693616332544:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360581:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360620:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787847288.360629:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+6:8435:x1874693616332544:12345-0@lo:104: Request processed in 57us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360635:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787847288.360647:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787847288.360653:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:8435:x1874693616332672:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360661:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360687:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787847288.360692:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:8435:x1874693616332672:12345-0@lo:104: Request processed in 40us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787847288.360708:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787847288.360713:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:8435:x1874693616332800:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360720:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360751:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787847288.360755:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:8435:x1874693616332800:12345-0@lo:104: Request processed in 43us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360760:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787847288.360771:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787847288.360776:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:8435:x1874693616332928:12345-0@lo:104: 00010000:00010000:1.0:1787847288.360783:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360806:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787847288.360815:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:8435:x1874693616332928:12345-0@lo:104: Request processed in 41us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.360821:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787847288.360846:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787847288.360853:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360861:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d0200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847288.360866:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.360874:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847288.360881:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847288.360887:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787847288.360925:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361670:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787847288.361681:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361690:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d0e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847288.361693:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361702:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847288.361710:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847288.361716:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847288.361740:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361747:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847288.361775:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361782:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0e00/0x1835de88b9861ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361799:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787847288.361802:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361823:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847288.361826:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361833:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847288.361841:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847288.361846:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847288.361861:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361866:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847288.361872:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361878:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152a000/0x1835de88b9861aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ad1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361888:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787847288.361891:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361897:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165cc00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847288.361900:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361922:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847288.361928:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847288.361977:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847288.361993:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.361998:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847288.362016:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362022:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9861abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362032:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787847288.362035:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362040:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847288.362043:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362048:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847288.362054:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847288.362064:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847288.362078:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362083:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847288.362088:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362093:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362102:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847288.362104:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362109:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d0400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847288.362111:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362116:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847288.362122:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847288.362128:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847288.362152:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362158:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847288.362168:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362174:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0400/0x1835de88b9861a84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a8b expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362183:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847288.362186:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362193:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847288.362196:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362202:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847288.362208:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847288.362213:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847288.362225:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362230:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847288.362234:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362240:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165d600/0x1835de88b9861a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a61 expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362250:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847288.362256:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847288.362258:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847288.362279:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333184:0@lo:103: 00000100:00100000:3.0:1787847288.362344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847288.362393:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333696:0@lo:103: 00000100:00100000:3.0:1787847288.362412:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847288.362437:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787847288.362443:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333312:0@lo:103: 00000100:00100000:3.0:1787847288.362463:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847288.362479:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333824:0@lo:103: 00000100:00100000:3.0:1787847288.362515:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847288.362548:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616333440:0@lo:103: 00000100:00100000:3.0:1787847288.362572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847288.362585:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847288.362590:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616333568:0@lo:103: 00000100:00100000:3.0:1787847288.362608:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847288.362634:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333184 00000100:00100000:3.0:1787847288.362642:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333184 00010000:00010000:3.0:1787847288.362677:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 19 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.362699:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333696 00000100:00100000:3.0:1787847288.362702:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333696 00010000:00010000:3.0:1787847288.362714:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a84 expref: 20 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.362724:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333312 00000100:00100000:3.0:1787847288.362727:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333312 00010000:00010000:3.0:1787847288.362744:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861aca expref: 21 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.362754:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333824 00000100:00100000:3.0:1787847288.362756:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333824 00010000:00010000:3.0:1787847288.362765:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a5a expref: 22 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.362774:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333440 00000100:00100000:3.0:1787847288.362776:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333440 00010000:00010000:3.0:1787847288.362785:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861abc expref: 23 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.362794:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333568 00000100:00100000:3.0:1787847288.362796:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333568 00010000:00010000:3.0:1787847288.362805:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861aae expref: 24 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.362817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787847288.362826:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+24:3302:x1874693616333184:12345-0@lo:103: 00010000:00010000:3.0:1787847288.362840:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.362846:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 24 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362857:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 24 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.362880:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.362914:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+24:3302:x1874693616333184:12345-0@lo:103: Request processed in 88us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.362921:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787847288.363065:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787847288.363073:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+23:3302:x1874693616333696:12345-0@lo:103: 00010000:00010000:3.0:1787847288.363083:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.363087:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a84 expref: 23 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363096:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861a84 expref: 23 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363106:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.363129:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+23:3302:x1874693616333696:12345-0@lo:103: Request processed in 58us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.363135:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787847288.363149:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787847288.363154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+22:3302:x1874693616333312:12345-0@lo:103: 00010000:00010000:3.0:1787847288.363162:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.363167:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861aca expref: 22 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363174:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861aca expref: 22 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363184:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.363205:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+22:3302:x1874693616333312:12345-0@lo:103: Request processed in 51us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.363212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787847288.363222:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787847288.363229:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+21:3302:x1874693616333824:12345-0@lo:103: 00010000:00010000:3.0:1787847288.363237:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.363246:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a5a expref: 21 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363254:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861a5a expref: 21 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363264:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.363285:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+21:3302:x1874693616333824:12345-0@lo:103: Request processed in 58us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.363291:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787847288.363304:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787847288.363310:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+20:3300:x1874693616333440:12345-0@lo:103: 00010000:00010000:3.0:1787847288.363317:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.363321:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861abc expref: 20 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363328:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861abc expref: 20 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363348:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.363490:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+20:3300:x1874693616333440:12345-0@lo:103: Request processed in 180us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.363497:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787847288.363509:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787847288.363515:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616333568:12345-0@lo:103: 00010000:00010000:3.0:1787847288.363523:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.363528:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861aae expref: 19 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363547:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861aae expref: 19 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363557:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.363623:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616333568:12345-0@lo:103: Request processed in 108us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.363630:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787847288.363731:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847288.363761:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847288.363785:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847288.363806:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337088 00000100:00100000:3.0:1787847288.363811:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337088 00000100:00100000:3.0:1787847288.363852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:3.0:1787847288.363860:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595337088:12345-192.168.201.21@tcp:101: 00010000:00010000:3.0:1787847288.363876:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847288.363894:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b51 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363915:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363927:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b51 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.363983:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.364000:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b51 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.364014:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7c00, rc 0) 00000100:00100000:3.0:1787847288.364060:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:5587:x1874693595337088:12345-192.168.201.21@tcp:101: Request processed in 202us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.364067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:3.0:1787847288.364167:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336832 00000100:00100000:3.0:1787847288.364172:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336832 00010000:00010000:3.0:1787847288.364186:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.364202:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595336960 00000100:00100000:3.0:1787847288.364205:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595336960 00010000:00010000:3.0:1787847288.364214:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 12 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.364224:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1787847288.364229:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:2347:x1874693595336832:12345-192.168.201.21@tcp:103: 00010000:00010000:3.0:1787847288.364236:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.364240:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 12 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.364249:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 12 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.364260:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.364281:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:2347:x1874693595336832:12345-192.168.201.21@tcp:103: Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.364288:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1787847288.364329:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00010000:00010000:1.0:1787847288.364883:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847288.364909:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.364919:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0200/0x1835de88b9861b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861b17 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.364957:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847288.364960:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847288.364962:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847288.364981:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847288.365117:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b800/0x1835de88b9861b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0aef expref: 11 pid: 5838 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365141:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c76580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616331904:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847288.365157:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332032:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847288.365168:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332160:0@lo:104: 00010000:00010000:0.0:1787847288.365178:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a400/0x1835de88b9861aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861ae6 expref: 18 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365188:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332288:0@lo:104: 00010000:00010000:0.0:1787847288.365197:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c29d1000/0x1835de88b9861ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861aca expref: 17 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365209:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332416:0@lo:104: 00010000:00010000:0.0:1787847288.365219:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b400/0x1835de88b9861ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861abc expref: 16 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365226:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332544:0@lo:104: 00010000:00010000:0.0:1787847288.365236:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c29d1a00/0x1835de88b9861ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861aae expref: 15 pid: 5835 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365256:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332672:0@lo:104: 00010000:00010000:0.0:1787847288.365269:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031600/0x1835de88b9861a8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861a84 expref: 14 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365278:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332800:0@lo:104: 00010000:00010000:0.0:1787847288.365288:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0030600/0x1835de88b9861a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861a5a expref: 13 pid: 5837 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847288.365297:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8435:1874693616332928:0@lo:104: 00010000:00010000:0.0:1787847288.365349:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847288.365840:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847288.366079:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616333056:0@lo:103: 00000100:00100000:2.0:1787847288.366197:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847288.366244:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616333568:0@lo:103: 00000100:00100000:2.0:1787847288.366252:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616333440:0@lo:103: 00000100:00100000:2.0:1787847288.366283:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333312:0@lo:103: 00000100:00100000:2.0:1787847288.366291:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333824:0@lo:103: 00000100:00100000:2.0:1787847288.366307:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333184:0@lo:103: 00000100:00100000:2.0:1787847288.366314:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616333696:0@lo:103: 00000100:00100000:2.0:1787847288.366519:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787847288.366529:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787847288.366681:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2347:x1874693595336960:12345-192.168.201.21@tcp:103: 00010000:00010000:3.0:1787847288.366703:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.366713:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366728:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366749:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152ac00/0x1835de88b9861b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ae8 expref: 10 pid: 5837 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366762:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847288.366801:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:2347:x1874693595336960:12345-192.168.201.21@tcp:103: Request processed in 2466us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.366810:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847288.366833:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616333056 00000100:00100000:3.0:1787847288.366838:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616333056 00010000:00010000:3.0:1787847288.366857:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861b10 expref: 13 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.366874:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787847288.366881:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3300:x1874693616333056:12345-0@lo:103: 00010000:00010000:3.0:1787847288.366890:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847288.366893:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861b10 expref: 13 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366901:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861b10 expref: 13 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366921:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152aa00/0x1835de88b9861b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861b10 expref: 13 pid: 5838 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366948:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366957:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366970:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366978:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366984:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366991:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.366997:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0031c00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847288.367001:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.367010:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.367021:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b51 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.367035:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b51 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847288.367530:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b51 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847288.367545:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5829:1874693616333952:192.168.201.21@tcp:105: 00000100:00100000:3.0:1787847288.367593:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa63c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787847288.367814:0:8435:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847288.367823:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847288.373949:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8b40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5829:1874693616333952:192.168.201.21@tcp:105: 00010000:00010000:1.0:1787847288.373997:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.374013:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861b64 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847288.374032:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847288.374102:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3300:x1874693616333056:12345-0@lo:103: Request processed in 7218us (7903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.374114:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787847288.375311:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847288.375803:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616333056:0@lo:103: 00000100:00100000:1.0:1787847288.382714:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337216 00000100:00100000:1.0:1787847288.382734:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337216 00000100:00100000:1.0:1787847288.382838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 134 00000100:00100000:1.0:1787847288.382851:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5587:x1874693595337216:12345-192.168.201.21@tcp:501: 00000100:00100000:1.0:1787847288.383277:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5587:x1874693595337216:12345-192.168.201.21@tcp:501: Request processed in 426us (7973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.383287:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 134 00000100:00100000:3.0:1787847288.398535:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847288.398617:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337344 00000100:00100000:1.0:1787847288.398629:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337344 00000100:00100000:1.0:1787847288.398700:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 135 00000100:00100000:1.0:1787847288.398713:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5587:x1874693595337344:12345-192.168.201.21@tcp:503: 00000100:00100000:1.0:1787847288.399045:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5587:x1874693595337344:12345-192.168.201.21@tcp:503: Request processed in 334us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847288.399064:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 135 00000100:00100000:0.0:1787847288.420550:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847288.420756:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337472 00000100:00100000:2.0:1787847288.420770:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337472 00000100:00100000:2.0:1787847288.420843:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 136 00000100:00100000:2.0:1787847288.420855:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:6047:x1874693595337472:12345-192.168.201.21@tcp:502: 00000100:00100000:2.0:1787847288.421592:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:6047:x1874693595337472:12345-192.168.201.21@tcp:502: Request processed in 736us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847288.421601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 136 00000100:00100000:2.0:1787847288.453145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847288.453285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337600 00000100:00100000:3.0:1787847288.453300:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337600 00000100:00100000:3.0:1787847288.453392:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:3.0:1787847288.453406:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:6047:x1874693595337600:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787847288.453819:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:6047:x1874693595337600:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 415us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.453828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:1.0:1787847288.473849:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847288.473959:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337728 00000100:00100000:2.0:1787847288.473972:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337728 00000100:00100000:2.0:1787847288.474038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 138 00000100:00100000:2.0:1787847288.474060:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5587:x1874693595337728:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847288.474084:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847288.474108:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152be00/0x1835de88b9861b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b58 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847288.474150:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152be00/0x1835de88b9861b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b58 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847288.474160:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152be00/0x1835de88b9861b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b58 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847288.474190:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152be00, rc 0) 00000100:00100000:2.0:1787847288.474263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595337728:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 215us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847288.474271:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 138 00000100:00100000:3.0:1787847288.484756:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847288.485084:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337856 00000100:00100000:1.0:1787847288.485113:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337856 00000100:00100000:1.0:1787847288.485279:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 139 00000100:00100000:1.0:1787847288.485291:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595337856:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847288.485613:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595337856:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 324us (878us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787847288.485622:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 139 00000100:00100000:1.0:1787847288.753023:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847288.753071:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847288.753347:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847288.754360:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338112 00000100:00100000:2.0:1787847288.754375:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338112 00000100:00100000:2.0:1787847288.754458:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338240 00000100:00100000:2.0:1787847288.754462:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338240 00000100:00100000:2.0:1787847288.754495:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1787847288.754507:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595338112:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847288.754605:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595338112:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 100us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847288.754613:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1787847288.754633:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1787847288.754639:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595338240:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847288.754665:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595338240:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847288.754672:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00080000:2.0:1787847288.754691:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847288.754696:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847288.755018:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595337984 00000100:00100000:3.0:1787847288.755026:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595337984 00000100:00100000:3.0:1787847288.755077:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:3.0:1787847288.755097:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595337984:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847288.755142:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595337984:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 59us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847288.755150:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00080000:2.0:1787847288.755580:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787847289.304297:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787847289.610473:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc03e5fc40 20000000:00000080:1.0:1787847289.610503:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d87c8251000 uarg=0000000000000000 20000000:01000000:1.0:1787847289.610563:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787847289.610572:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787847289.610579:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787847289.615596:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787847289.615866:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787847289.624289:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787847289.624371:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787847289.624434:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787847289.624456:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787847289.624483:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624507:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b986199d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624529:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a14 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624536:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861a76 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624547:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624556:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624611:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.624631:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 9 pid: 5838 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.624651:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334080:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847289.625201:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861a76 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.625212:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861a76 expref: 11 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.625223:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334208:0@lo:104: 00000100:00100000:0.0:1787847289.625281:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787847289.625384:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861a14 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.625400:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861a14 expref: 11 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.625408:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334336:0@lo:104: 00000100:00100000:0.0:1787847289.625433:0:8489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.629778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847289.629979:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338368 00000100:00100000:1.0:1787847289.629993:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338368 00010000:00010000:1.0:1787847289.630046:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 10 pid: 5838 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847289.630097:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:1.0:1787847289.630108:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595338368:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847289.630129:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847289.630136:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 10 pid: 5838 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847289.630151:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 10 pid: 5838 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847289.630205:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847289.630278:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595338368:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 171us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847289.630287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00010000:00010000:0.0:1787847289.645438:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b986199d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.645463:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b986199d expref: 11 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.645481:0:8489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334464:0@lo:104: 00000100:00100000:0.0:1787847289.645539:0:8489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787847289.645579:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861b3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b20 expref: 9 pid: 5838 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.645596:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334080:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847289.646842:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787847289.646890:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.646928:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334208 00000100:00100000:3.0:1787847289.646964:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334208 00000100:00100000:3.0:1787847289.647039:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334336 00000100:00100000:3.0:1787847289.647043:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334336 00000100:00100000:3.0:1787847289.647054:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334464 00000100:00100000:3.0:1787847289.647056:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334464 00000100:00100000:3.0:1787847289.647073:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787847289.647083:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:8489:x1874693616334208:12345-0@lo:104: 00010000:00010000:3.0:1787847289.647106:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647194:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787847289.647200:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+5:8489:x1874693616334208:12345-0@lo:104: Request processed in 119us (21920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.647208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787847289.647227:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787847289.647233:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:8489:x1874693616334336:12345-0@lo:104: 00010000:00010000:3.0:1787847289.647240:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647277:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787847289.647282:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c26450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:8489:x1874693616334336:12345-0@lo:104: Request processed in 50us (21848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.647288:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1787847289.647338:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847289.647362:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647369:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d0600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847289.647373:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647381:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847289.647389:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847289.647395:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787847289.647435:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647443:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847289.647465:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647473:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d0600/0x1835de88b9861a76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a7d expref: -99 pid: 7616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647488:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847289.647491:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647497:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847289.647500:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647516:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847289.647522:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847289.647526:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787847289.647539:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647545:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847289.647559:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647565:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152ae00/0x1835de88b9861a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861a1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647574:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847289.647576:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847289.647578:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847289.647594:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616334592:0@lo:103: 00000100:00100000:3.0:1787847289.647634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.647684:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847289.647693:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616334720:0@lo:103: 00000100:00100000:3.0:1787847289.647715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.647741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334592 00000100:00100000:3.0:1787847289.647746:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334592 00010000:00010000:3.0:1787847289.647770:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a76 expref: 12 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847289.647803:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334720 00000100:00100000:3.0:1787847289.647806:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334720 00010000:00010000:3.0:1787847289.647817:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a14 expref: 13 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847289.647834:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847289.647841:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3301:x1874693616334592:12345-0@lo:103: 00010000:00010000:3.0:1787847289.647852:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847289.647858:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a76 expref: 13 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647868:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861a76 expref: 13 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647888:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847289.647914:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bda940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:3301:x1874693616334592:12345-0@lo:103: Request processed in 74us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.647920:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847289.647958:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787847289.647964:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3303:x1874693616334720:12345-0@lo:103: 00010000:00010000:3.0:1787847289.647971:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847289.647975:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861a14 expref: 12 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647983:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861a14 expref: 12 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.647993:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847289.648023:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3303:x1874693616334720:12345-0@lo:103: Request processed in 59us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.648030:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787847289.648068:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616334720:0@lo:103: 00000100:00100000:3.0:1787847289.648095:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616334592:0@lo:103: 00000100:00100000:3.0:1787847289.648115:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787847289.648122:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:8489:x1874693616334464:12345-0@lo:104: 00010000:00010000:3.0:1787847289.648131:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.648161:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787847289.648166:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:8489:x1874693616334464:12345-0@lo:104: Request processed in 46us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.648172:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1787847289.649122:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847289.649134:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649166:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847289.649170:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649180:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847289.649188:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847289.649193:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787847289.649229:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649236:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847289.649257:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649264:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165d200/0x1835de88b986199d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b98619a4 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649286:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847289.649288:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847289.649290:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847289.649325:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847289.649343:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616334848:0@lo:103: 00000100:00100000:2.0:1787847289.649399:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787847289.649454:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847289.649465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334848 00000100:00100000:2.0:1787847289.649477:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334848 00010000:00010000:2.0:1787847289.649504:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986199d expref: 12 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847289.649531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787847289.649541:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3302:x1874693616334848:12345-0@lo:103: 00010000:00010000:2.0:1787847289.649553:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847289.649558:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b986199d expref: 12 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649569:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b986199d expref: 12 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649588:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649599:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649619:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649628:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649636:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649642:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649649:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0030e00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847289.649660:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649669:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649678:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.649689:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847289.649722:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:3302:x1874693616334848:12345-0@lo:103: Request processed in 183us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.649730:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787847289.649767:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616334848:0@lo:103: 00010000:00010000:0.0:1787847289.651022:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a800/0x1835de88b9861a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861a76 expref: 11 pid: 5838 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.651043:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052e1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334208:0@lo:104: 00010000:00010000:0.0:1787847289.651064:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c29d1c00/0x1835de88b9861a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861a14 expref: 10 pid: 5837 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.651075:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334336:0@lo:104: 00010000:00010000:0.0:1787847289.651087:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165de00/0x1835de88b98619a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b986199d expref: 9 pid: 5835 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.651119:0:8489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1874693616334464:0@lo:104: 00010000:00010000:0.0:1787847289.651154:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.651163:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.651169:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.651175:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0030e00/0x1835de88b9861b79 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847289.660320:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 10000000:01000000:3.0:1787847289.888271:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787847289.888281:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87ff957000 from 39 10000000:01000000:3.0:1787847289.888288:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847289.888367:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.888381:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.888395:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847289.888426:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616334976:0@lo:101: 00000100:00100000:3.0:1787847289.888522:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847289.888570:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616334976 00000100:00100000:2.0:1787847289.888581:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616334976 00000100:00100000:2.0:1787847289.888909:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787847289.888921:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+9:5840:x1874693616334976:12345-0@lo:101: 00010000:00010000:2.0:1787847289.888955:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847289.888973:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a000/0x1835de88b9861b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861b80 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.889002:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a000/0x1835de88b9861b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861b80 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.889016:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a000/0x1835de88b9861b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861b80 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.889028:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a000, rc 0) 00000100:00100000:2.0:1787847289.889086:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5840:x1874693616334976:12345-0@lo:101: Request processed in 168us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.889101:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787847289.894269:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d8800334000 going to sleep for 11 seconds 00000100:00100000:0.0:1787847289.894339:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616334976:0@lo:101: 00010000:00010000:0.0:1787847289.894373:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.894389:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.894552:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335104:0@lo:501: 00000100:00100000:0.0:1787847289.894631:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.894672:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847289.895956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335104 00000100:00100000:3.0:1787847289.898820:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335104 00000100:00100000:3.0:1787847289.898913:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787847289.898953:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5840:x1874693616335104:12345-0@lo:501: 00000100:00100000:3.0:1787847289.899457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5840:x1874693616335104:12345-0@lo:501: Request processed in 507us (4824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.899465:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787847289.901089:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335104:0@lo:501: 00000100:00100000:0.0:1787847289.901162:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335232:0@lo:503: 00000100:00100000:0.0:1787847289.901234:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.901284:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847289.903229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335232 00000100:00100000:2.0:1787847289.903247:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335232 00000100:00100000:2.0:1787847289.903328:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787847289.903340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5840:x1874693616335232:12345-0@lo:503: 00000100:00100000:2.0:1787847289.903624:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5840:x1874693616335232:12345-0@lo:503: Request processed in 285us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.903633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787847289.910403:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335232:0@lo:503: 00000100:00100000:3.0:1787847289.912716:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8499:1874693616335360:0@lo:502: 00000100:00100000:3.0:1787847289.912821:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.912885:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d8800334540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847289.913297:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335360 00000100:00100000:2.0:1787847289.913317:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335360 00000100:00100000:2.0:1787847289.913380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787847289.913393:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:8499:x1874693616335360:12345-0@lo:502: 00000100:00100000:2.0:1787847289.913696:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:8499:x1874693616335360:12345-0@lo:502: Request processed in 306us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.913705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787847289.913856:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8499:1874693616335360:0@lo:502: 00000100:00100000:0.0:1787847289.913906:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8499:1874693616335488:0@lo:502: 00000100:00100000:0.0:1787847289.913964:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.913988:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847289.914158:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335488 00000100:00100000:2.0:1787847289.914163:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335488 00000100:00100000:2.0:1787847289.914294:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787847289.914302:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:8499:x1874693616335488:12345-0@lo:502: 00000100:00100000:2.0:1787847289.914450:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:8499:x1874693616335488:12345-0@lo:502: Request processed in 148us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.914457:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787847289.918212:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8499:1874693616335488:0@lo:502: 00000040:00080000:0.0:1787847289.918272:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787847289.918385:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787847289.918408:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787847289.918421:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.918434:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847289.920576:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787847289.920581:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787847289.920585:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787847289.920637:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.920648:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.920662:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.920691:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335616:0@lo:101: 00000100:00100000:0.0:1787847289.920785:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.920969:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335616 00000100:00100000:3.0:1787847289.920979:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335616 00000100:00100000:3.0:1787847289.921045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787847289.921300:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+10:5840:x1874693616335616:12345-0@lo:101: 00010000:00010000:3.0:1787847289.921327:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847289.921346:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9861b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861b8e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.921377:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9861b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861b8e expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.921388:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9861b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861b8e expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.921399:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6600, rc 0) 00000100:00100000:3.0:1787847289.921515:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616335616:12345-0@lo:101: Request processed in 387us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.921524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787847289.923975:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847289.924137:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335616:0@lo:101: 00010000:00010000:0.0:1787847289.924171:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.924186:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.924286:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335744:0@lo:501: 00000100:00100000:0.0:1787847289.924375:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.924410:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847289.925183:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335744 00000100:00100000:3.0:1787847289.925207:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335744 00000100:00100000:3.0:1787847289.925263:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787847289.925273:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616335744:12345-0@lo:501: 00000100:00100000:3.0:1787847289.927600:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616335744:12345-0@lo:501: Request processed in 2318us (3214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.927615:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787847289.929158:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335744:0@lo:501: 00000100:00100000:0.0:1787847289.929244:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335872:0@lo:503: 00000100:00100000:0.0:1787847289.929342:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.929390:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847289.930319:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616335872 00000100:00100000:1.0:1787847289.930330:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616335872 00000100:00100000:1.0:1787847289.930393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787847289.930403:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616335872:12345-0@lo:503: 00000100:00100000:1.0:1787847289.932425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616335872:12345-0@lo:503: Request processed in 2011us (3073us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.933608:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616335872:0@lo:503: 00000100:00100000:1.0:1787847289.933827:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787847289.935142:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8501:1874693616336000:0@lo:502: 00000100:00100000:3.0:1787847289.935243:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.935299:0:8501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d8800334780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847289.935426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336000 00000100:00100000:2.0:1787847289.935435:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336000 00000100:00100000:2.0:1787847289.935496:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787847289.935514:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:8501:x1874693616336000:12345-0@lo:502: 00000100:00100000:2.0:1787847289.935798:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:8501:x1874693616336000:12345-0@lo:502: Request processed in 285us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.935808:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787847289.938091:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdb840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8501:1874693616336000:0@lo:502: 00000020:01000000:1.0:1787847289.938149:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787847289.938163:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787847289.938166:0:8501:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787847289.938174:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787847289.938219:0:8501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8501:1874693616336128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787847289.938303:0:8501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847289.938369:0:8501:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847289.938386:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336128 00000100:00100000:2.0:1787847289.938395:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336128 00000100:00100000:2.0:1787847289.938457:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787847289.938468:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:8501:x1874693616336128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847289.939209:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:8501:x1874693616336128:12345-0@lo:502:llog_process_th.0 Request processed in 739us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.939219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787847289.939357:0:8501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8501:1874693616336128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787847289.939386:0:8501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787847289.939393:0:8501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787847289.939396:0:8501:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787847289.939400:0:8501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787847289.939749:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787847289.939779:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787847289.939792:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.939805:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847289.939818:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787847289.939821:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ff957000 from 4 10000000:01000000:2.0:1787847289.939825:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787847289.939866:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.939876:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.939886:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847289.939912:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787847289.939967:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847289.939997:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847289.942046:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336256 00000100:00100000:3.0:1787847289.942070:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336256 00000100:00100000:3.0:1787847289.942139:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787847289.942150:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+11:5840:x1874693616336256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847289.942170:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847289.942195:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861b9c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.942228:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861b9c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.942241:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861b9c expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.942252:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6400, rc 0) 00000100:00100000:3.0:1787847289.942344:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616336256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.942352:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787847289.942813:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847289.942837:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847289.942848:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847289.942967:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847289.943020:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847289.943061:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787847289.944059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336384 00000100:00100000:1.0:1787847289.944075:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336384 00000100:00100000:1.0:1787847289.944134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787847289.944144:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616336384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847289.944457:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616336384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847289.944465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787847289.948058:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847289.948152:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847289.948246:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847289.948298:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847289.948351:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336512 00000100:00100000:3.0:1787847289.948367:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336512 00000100:00100000:3.0:1787847289.948441:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787847289.948452:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616336512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847289.948698:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616336512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.948711:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787847289.948971:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847289.958283:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8502:1874693616336640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.958410:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.958462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336640 00000100:00100000:0.0:1787847289.958470:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336640 00000100:00100000:0.0:1787847289.958570:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787847289.958581:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:8502:x1874693616336640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.958972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:8502:x1874693616336640:12345-0@lo:502:llog_process_th.0 Request processed in 390us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847289.958982:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787847289.959045:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787847289.959191:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8502:1874693616336640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847289.959229:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847289.959241:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847289.959244:0:8502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787847289.959251:0:8502:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87ff957000 00000020:00000080:0.0:1787847289.959254:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787847289.959354:0:8502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8502:1874693616336768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.959393:0:8502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.959413:0:8502:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ee3600 going to sleep for 11 seconds 00000100:00100000:3.0:1787847289.959675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336768 00000100:00100000:3.0:1787847289.959681:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336768 00000100:00100000:3.0:1787847289.959718:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787847289.959727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:8502:x1874693616336768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847289.959916:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:8502:x1874693616336768:12345-0@lo:502:llog_process_th.0 Request processed in 190us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847289.959924:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787847289.960328:0:8502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8502:1874693616336768:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847289.960353:0:8502:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847289.960359:0:8502:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847289.960361:0:8502:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787847289.960365:0:8502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787847289.963457:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787847289.963505:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847289.963518:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.963533:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847289.963546:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787847289.963549:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87ef8a4000 from 39 10000000:01000000:3.0:1787847289.963552:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847289.963599:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.963607:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.963634:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847289.963666:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787847289.963752:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.963827:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847289.965002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616336896 00000100:00100000:0.0:1787847289.965018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616336896 00000100:00100000:0.0:1787847289.965098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787847289.965110:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+12:5840:x1874693616336896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847289.965130:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847289.965151:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861bb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861baa expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.965186:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861baa expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.965198:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861bb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861baa expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.965209:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c0031c00, rc 0) 00000100:00100000:0.0:1787847289.965290:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616336896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847289.965298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787847289.966770:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616336896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847289.966802:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847289.969214:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847289.976178:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847289.976833:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847289.976908:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847289.981984:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337024 00000100:00100000:1.0:1787847289.982001:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337024 00000100:00100000:1.0:1787847289.982064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787847289.982077:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616337024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847289.982440:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616337024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 366us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847289.982449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787847289.982511:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847289.982577:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847289.982624:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847289.982664:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847289.983023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337152 00000100:00100000:0.0:1787847289.983030:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337152 00000100:00100000:0.0:1787847289.983071:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787847289.983079:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616337152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847289.983259:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616337152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847289.983267:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787847289.983327:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847289.983568:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8507:1874693616337280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.983612:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.983637:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337280 00000100:00100000:0.0:1787847289.983640:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337280 00000100:00100000:0.0:1787847289.983665:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787847289.983671:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:8507:x1874693616337280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.985100:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:8507:x1874693616337280:12345-0@lo:502:llog_process_th.0 Request processed in 1418us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847289.985114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787847289.985185:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847289.985206:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8507:1874693616337280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.985270:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8507:1874693616337408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847289.987985:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.988096:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847289.988098:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337408 00000100:00100000:2.0:1787847289.988109:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337408 00000100:00100000:2.0:1787847289.988174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787847289.988187:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:8507:x1874693616337408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847289.991378:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:8507:x1874693616337408:12345-0@lo:502:llog_process_th.0 Request processed in 3181us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847289.991396:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787847289.993249:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8507:1874693616337408:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787847289.993331:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787847289.995665:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787847289.995772:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787847289.995787:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.995801:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847289.996289:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787847289.996294:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787847289.996298:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787847289.996366:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.996377:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847289.996391:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847289.996424:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787847289.996514:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847289.996606:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847290.003906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337536 00000100:00100000:1.0:1787847290.003924:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337536 00000100:00100000:1.0:1787847290.014572:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787847290.014589:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+13:5840:x1874693616337536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847290.014611:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847290.014648:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165d800/0x1835de88b9861bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861bb8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.014690:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165d800/0x1835de88b9861bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861bb8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.014704:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165d800/0x1835de88b9861bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bb8 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.014725:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d800, rc 0) 00000100:00100000:1.0:1787847290.014973:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616337536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 386us (18457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847290.014982:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787847290.015057:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847290.015081:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.015093:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847290.015181:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.015218:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.015253:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787847290.015276:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337664 00000100:00100000:1.0:1787847290.015282:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337664 00000100:00100000:1.0:1787847290.015335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787847290.015343:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616337664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.015621:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616337664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847290.015637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787847290.015654:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.015697:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.015748:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.015766:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.015782:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337792 00000100:00100000:3.0:1787847290.015786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337792 00000100:00100000:3.0:1787847290.015816:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787847290.015824:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616337792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.016025:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616337792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.016039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787847290.016077:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616337792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.017256:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8508:1874693616337920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.017341:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.017429:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a973c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.017468:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616337920 00000100:00100000:0.0:1787847290.017474:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616337920 00000100:00100000:0.0:1787847290.017556:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787847290.017568:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:8508:x1874693616337920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847290.017786:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:8508:x1874693616337920:12345-0@lo:502:llog_process_th.0 Request processed in 221us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.017803:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787847290.017873:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8508:1874693616337920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847290.017903:0:8508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847290.017913:0:8508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847290.017916:0:8508:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787847290.017923:0:8508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787847290.017980:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8508:1874693616338048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.018016:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.018036:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338048 00000100:00100000:3.0:1787847290.018040:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338048 00000100:00100000:1.0:1787847290.018064:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787847290.018077:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:8508:x1874693616338048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.018085:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847290.018216:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:8508:x1874693616338048:12345-0@lo:502:llog_process_th.0 Request processed in 142us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847290.018224:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787847290.018256:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8508:1874693616338048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847290.018275:0:8508:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847290.018279:0:8508:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847290.018281:0:8508:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787847290.018285:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1787847290.018443:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1787847290.018468:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787847290.018479:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.018491:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847290.018504:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787847290.018506:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ef8a4000 from 4 10000000:01000000:0.0:1787847290.018510:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787847290.018540:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.018549:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.018559:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847290.018573:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.018606:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.018658:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609300 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.018687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338176 00000100:00100000:3.0:1787847290.018691:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338176 00000100:00100000:3.0:1787847290.018746:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787847290.018755:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:5840:x1874693616338176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847290.018766:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847290.018782:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861bc6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.018818:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.018830:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.018840:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7800, rc 0) 00000100:00100000:3.0:1787847290.018886:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616338176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.018893:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787847290.018978:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847290.018994:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.019004:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847290.019052:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.019079:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.019657:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2840 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.019700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338304 00000100:00100000:0.0:1787847290.019715:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338304 00000100:00100000:0.0:1787847290.019748:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787847290.019773:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616338304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.020056:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616338304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.020068:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787847290.020299:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.020351:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.020393:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.020460:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2840 going to sleep for 11 seconds 00000100:00100000:1.0:1787847290.020506:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338432 00000100:00100000:1.0:1787847290.020510:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338432 00000100:00100000:3.0:1787847290.020564:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787847290.020573:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616338432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.020738:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616338432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.020745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787847290.020824:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.021260:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8509:1874693616338560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787847290.021314:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.021374:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2000 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.021481:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338560 00000100:00100000:3.0:1787847290.021486:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338560 00000100:00100000:3.0:1787847290.021544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787847290.021552:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:8509:x1874693616338560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.021758:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:8509:x1874693616338560:12345-0@lo:502:llog_process_th.0 Request processed in 205us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.021766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787847290.021840:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8509:1874693616338560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847290.021865:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847290.021877:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847290.021879:0:8509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787847290.021887:0:8509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87ef8a4000 00000020:00000080:0.0:1787847290.021890:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787847290.022052:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8509:1874693616338688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847290.022089:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.022203:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609840 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.022258:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338688 00000100:00100000:3.0:1787847290.022262:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338688 00000100:00100000:3.0:1787847290.022297:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787847290.022315:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:8509:x1874693616338688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.022444:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:8509:x1874693616338688:12345-0@lo:502:llog_process_th.0 Request processed in 139us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.022450:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787847290.022522:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8509:1874693616338688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847290.022542:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847290.022547:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847290.022548:0:8509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787847290.022553:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787847290.022720:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787847290.022741:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847290.022753:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.022767:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847290.022779:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787847290.022783:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87d0568000 from 39 10000000:01000000:3.0:1787847290.022786:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847290.022817:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.022828:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.022838:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847290.022854:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.022886:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.022923:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.023045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338816 00000100:00100000:0.0:1787847290.023049:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338816 00000100:00100000:0.0:1787847290.023078:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787847290.023085:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:5840:x1874693616338816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847290.023096:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847290.023121:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c0031600/0x1835de88b9861bdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861bd4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.023149:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c0031600/0x1835de88b9861bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861bd4 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.023161:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c0031600/0x1835de88b9861bdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bd4 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.023179:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c0031600, rc 0) 00000100:00100000:0.0:1787847290.023218:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616338816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.023225:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787847290.023340:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847290.023352:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.023368:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847290.023421:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.023452:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.023482:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.023525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616338944 00000100:00100000:0.0:1787847290.023530:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616338944 00000100:00100000:0.0:1787847290.023554:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787847290.023562:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616338944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.023860:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616338944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.023867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787847290.024414:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616338944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.024453:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.024498:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.024568:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.024600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339072 00000100:00100000:0.0:1787847290.024609:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339072 00000100:00100000:0.0:1787847290.024672:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787847290.024681:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616339072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.024858:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616339072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.024865:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787847290.024918:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.026446:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8510:1874693616339200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.026531:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.026592:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.026734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339200 00000100:00100000:0.0:1787847290.026743:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339200 00000100:00100000:0.0:1787847290.026795:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787847290.026806:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:8510:x1874693616339200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847290.027094:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:8510:x1874693616339200:12345-0@lo:502:llog_process_th.0 Request processed in 289us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.027103:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787847290.027216:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8510:1874693616339200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.027270:0:8510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8510:1874693616339328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.027302:0:8510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847290.027340:0:8510:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.027379:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339328 00000100:00100000:0.0:1787847290.027383:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339328 00000100:00100000:0.0:1787847290.027413:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1787847290.027419:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:8510:x1874693616339328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847290.027539:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:8510:x1874693616339328:12345-0@lo:502:llog_process_th.0 Request processed in 119us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.027546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787847290.027668:0:8510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8510:1874693616339328:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787847290.027686:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787847290.028042:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787847290.028062:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787847290.028073:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.028085:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847290.028096:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787847290.028100:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787847290.028103:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787847290.028158:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.028167:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.028178:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847290.028194:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.028229:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.028258:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d177f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.028373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339456 00000100:00100000:3.0:1787847290.028379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339456 00000100:00100000:3.0:1787847290.028418:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787847290.028433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616339456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847290.028444:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847290.028459:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7a00/0x1835de88b9861be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861be2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.028493:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7a00/0x1835de88b9861be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861be2 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.028505:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7a00/0x1835de88b9861be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861be2 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.028514:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7a00, rc 0) 00000100:00100000:3.0:1787847290.028545:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616339456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.028552:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787847290.028709:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847290.028723:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.028733:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847290.028785:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.028809:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.028837:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d177f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.028851:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339584 00000100:00100000:0.0:1787847290.028854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339584 00000100:00100000:0.0:1787847290.028874:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787847290.028880:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616339584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.029224:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616339584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.029232:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787847290.029265:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.029297:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.029357:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.029372:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d177f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.029384:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339712 00000100:00100000:0.0:1787847290.029387:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339712 00000100:00100000:0.0:1787847290.029408:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787847290.029414:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616339712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.029785:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616339712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.029793:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787847290.037886:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616339712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847290.039855:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8512:1874693616339840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847290.043981:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847290.046648:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847290.057882:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339840 00000100:00100000:0.0:1787847290.057901:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339840 00000100:00100000:0.0:1787847290.058194:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787847290.058207:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:8512:x1874693616339840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847290.058605:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:8512:x1874693616339840:12345-0@lo:502:llog_process_th.0 Request processed in 400us (14635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.058613:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787847290.058999:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8512:1874693616339840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787847290.059055:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847290.059068:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847290.059070:0:8512:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787847290.059083:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787847290.059130:0:8512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8512:1874693616339968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847290.059188:0:8512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847290.059235:0:8512:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.059477:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616339968 00000100:00100000:3.0:1787847290.059484:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616339968 00000100:00100000:3.0:1787847290.059533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787847290.059543:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:8512:x1874693616339968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.059763:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:8512:x1874693616339968:12345-0@lo:502:llog_process_th.0 Request processed in 221us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.059770:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787847290.059917:0:8512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8512:1874693616339968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787847290.059960:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847290.059967:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847290.059970:0:8512:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787847290.059976:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787847290.060089:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787847290.060118:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787847290.060131:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.060145:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847290.060157:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787847290.060160:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87d0568000 from 4 10000000:01000000:0.0:1787847290.060163:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787847290.060196:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.060205:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.060215:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847290.060240:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.060279:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.060329:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fb480 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.061664:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340096 00000100:00100000:3.0:1787847290.061678:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340096 00000100:00100000:3.0:1787847290.061750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787847290.061763:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616340096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847290.061793:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847290.061817:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861bf0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.061853:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.061867:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.061879:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6000, rc 0) 00000100:00100000:3.0:1787847290.061981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616340096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.061989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787847290.062081:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847290.062108:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847290.062121:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847290.062197:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.062232:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.062275:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fb480 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.062601:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340224 00000100:00100000:3.0:1787847290.062608:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340224 00000100:00100000:3.0:1787847290.062647:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787847290.062657:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616340224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.063013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616340224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.063021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787847290.063106:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.063297:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.063353:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847290.063389:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fb480 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.063720:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340352 00000100:00100000:3.0:1787847290.063726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340352 00000100:00100000:3.0:1787847290.063770:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787847290.063779:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616340352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847290.064017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616340352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.064035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787847290.066495:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847290.067018:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8514:1874693616340480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847290.067116:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847290.067155:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847290.067340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340480 00000100:00100000:3.0:1787847290.067347:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340480 00000100:00100000:3.0:1787847290.067396:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787847290.067404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:8514:x1874693616340480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847290.068425:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:8514:x1874693616340480:12345-0@lo:502:llog_process_th.0 Request processed in 1017us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.068435:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787847290.068603:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8514:1874693616340480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787847290.069062:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847290.069077:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847290.069080:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787847290.069092:0:8514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87d0568000 00000020:00000080:2.0:1787847290.069095:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787847290.069199:0:8514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8514:1874693616340608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847290.069271:0:8514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847290.069343:0:8514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787847290.069385:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340608 00000100:00100000:1.0:1787847290.069393:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340608 00000100:00100000:1.0:1787847290.069446:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787847290.069458:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:8514:x1874693616340608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787847290.069734:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:8514:x1874693616340608:12345-0@lo:502:llog_process_th.0 Request processed in 279us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847290.069743:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787847290.069802:0:8514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:8514:1874693616340608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787847290.069825:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847290.069829:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847290.069831:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787847290.069837:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787847290.072401:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787847290.072798:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787847290.072816:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.072831:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847290.072843:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787847290.072847:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d87c51c33a0 from 1 10000000:01000000:1.0:1787847290.072850:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787847290.072903:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.072913:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.072927:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847290.072981:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.073815:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.073875:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787847290.073911:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340736 00000100:00100000:1.0:1787847290.073919:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340736 00000100:00100000:2.0:1787847290.075060:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787847290.075080:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616340736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847290.075101:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847290.075122:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a200/0x1835de88b9861c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861bfe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847290.075154:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a200/0x1835de88b9861c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861bfe expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847290.075167:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a200/0x1835de88b9861c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bfe expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847290.075177:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a200, rc 0) 00000100:00100000:2.0:1787847290.075243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616340736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 170us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847290.075251:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787847290.075300:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847290.075332:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.075344:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847290.075428:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847290.075465:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.075502:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6ec2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787847290.075510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340864 00000100:00100000:2.0:1787847290.075517:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340864 00000100:00100000:2.0:1787847290.075553:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787847290.075560:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616340864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847290.075905:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616340864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (439us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787847290.075922:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787847290.076120:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616340864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787847290.076147:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787847290.076156:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.076165:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847290.335497:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847290.484032:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847290.484126:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338496 00000100:00100000:1.0:1787847290.484137:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338496 00000100:00100000:1.0:1787847290.484212:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 187 00000100:00100000:1.0:1787847290.484224:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:5587:x1874693595338496:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847290.484241:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847290.484273:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b5f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.484325:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.484338:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847290.484348:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d200, rc 0) 00000100:00100000:1.0:1787847290.484412:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595338496:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 190us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847290.484419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 187 00000100:00100000:1.0:1787847290.489430:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847290.489673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338624 00000100:00100000:2.0:1787847290.489683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338624 00000100:00100000:2.0:1787847290.489733:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 188 00000100:00100000:2.0:1787847290.489743:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595338624:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847290.490083:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595338624:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 339us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847290.490091:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 188 00000100:00100000:1.0:1787847290.495095:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847290.495182:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338752 00000100:00100000:0.0:1787847290.495193:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338752 00000100:00100000:0.0:1787847290.495247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 189 00000100:00100000:0.0:1787847290.495258:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595338752:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847290.495530:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:5587:x1874693595338752:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 273us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.495546:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 189 00000100:00100000:0.0:1787847290.507505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847290.508077:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595338880 00000100:00100000:3.0:1787847290.508086:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595338880 00000100:00100000:3.0:1787847290.508146:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 190 00000100:00100000:3.0:1787847290.508158:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:6106:x1874693595338880:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787847290.508445:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:6106:x1874693595338880:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 288us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847290.508462:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 190 00000100:00100000:3.0:1787847290.511174:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847290.514005:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339008 00000100:00100000:0.0:1787847290.514020:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339008 00000100:00100000:0.0:1787847290.514092:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 191 00000100:00100000:0.0:1787847290.514103:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:6106:x1874693595339008:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787847290.514400:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:6106:x1874693595339008:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 288us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847290.514409:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 191 00000100:00100000:0.0:1787847290.967342:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847290.967371:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616340992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787847290.967447:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847290.967579:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616340992 00000100:00100000:1.0:1787847290.967588:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616340992 00000100:00100000:1.0:1787847290.967666:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787847290.967677:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616340992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847290.967713:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847290.967763:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616340992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847290.967770:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787847290.967807:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce0000 x1874693616340992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847290.967827:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616340992:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787847290.967919:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787847291.354685:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847292.375412:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847292.508077:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616341248:0@lo:400:kworker.0 00000100:00100000:0.0:1787847292.508091:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616341376:0@lo:400:kworker.0 00000100:00100000:2.0:1787847292.508478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847292.508512:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847292.508577:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341248 00000100:00100000:2.0:1787847292.508581:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341376 00000100:00100000:0.0:1787847292.508585:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341248 00000100:00100000:2.0:1787847292.508587:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341376 00000100:00100000:3.0:1787847292.508633:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616341504:0@lo:400:kworker.0 00000100:00100000:2.0:1787847292.508644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787847292.509075:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847292.509106:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847292.509113:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616341120:0@lo:400:kworker.0 00000100:00100000:2.0:1787847292.509160:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616341376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847292.509181:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787847292.509190:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616341248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847292.509225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616341376:12345-0@lo:400:kworker.0 Request processed in 571us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847292.509234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787847292.509243:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616341248:12345-0@lo:400:kworker.0 Request processed in 53us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847292.509251:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787847292.509306:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616341376:0@lo:400:kworker.0 00000100:00100000:0.0:1787847292.509337:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616341248:0@lo:400:kworker.0 00000100:00100000:0.0:1787847292.509377:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847292.509384:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616341760:0@lo:400:kworker.0 00000100:00100000:3.0:1787847292.510353:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847292.510405:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616341632:0@lo:400:kworker.0 00000100:00100000:3.0:1787847292.510439:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787847292.510488:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847292.510506:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341632 00000100:00100000:3.0:1787847292.510510:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341632 00000100:00100000:3.0:1787847292.510550:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787847292.510558:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616341632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847292.510596:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616341632:12345-0@lo:400:kworker.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847292.510602:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787847292.510622:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341504 00000100:00100000:3.0:1787847292.510625:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341504 00000100:00100000:3.0:1787847292.510655:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787847292.510662:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616341504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847292.510822:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bda580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616341504:12345-0@lo:400:kworker.0 Request processed in 161us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847292.510829:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787847292.510864:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787847292.510867:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847292.510889:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616341632:0@lo:400:kworker.0 00010000:00080000:3.0:1787847292.510903:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880052d2c0 x1874693616341504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847292.511054:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616341504:0@lo:400:kworker.0 00000100:00100000:1.0:1787847292.511484:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341120 00000100:00100000:1.0:1787847292.511490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341120 00000100:00100000:1.0:1787847292.511525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787847292.511532:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616341120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847292.511578:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616341120:12345-0@lo:400:kworker.0 Request processed in 46us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847292.511584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787847292.511626:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616341120:0@lo:400:kworker.0 00000100:00100000:1.0:1787847292.514161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847292.514220:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341760 00000100:00100000:1.0:1787847292.514227:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341760 00000100:00100000:1.0:1787847292.514298:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787847292.514309:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616341760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847292.514366:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616341760:12345-0@lo:400:kworker.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847292.514374:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787847292.514434:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880052ed00 x1874693616341760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847292.514449:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616341760:0@lo:400:kworker.0 00000100:00080000:2.0:1787847292.522122:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787847293.015812:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847293.015838:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616341888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847293.015921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847293.016010:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616341888 00000100:00100000:1.0:1787847293.016018:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616341888 00000100:00100000:1.0:1787847293.016060:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787847293.016070:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616341888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847293.016118:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847293.016164:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616341888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847293.016171:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1787847293.016207:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f36d00 x1874693616341888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847293.016227:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616341888:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787847293.399239:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847293.879336:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847293.879384:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847293.879421:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847293.879451:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847293.879499:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339264 00000100:00100000:3.0:1787847293.879512:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339264 00000100:00100000:3.0:1787847293.879592:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:3.0:1787847293.879606:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595339264:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847293.879702:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595339264:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847293.879711:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:3.0:1787847293.879736:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339392 00000100:00100000:3.0:1787847293.879739:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339392 00000100:00100000:3.0:1787847293.879768:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339520 00000100:00100000:3.0:1787847293.879771:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339520 00000100:00100000:3.0:1787847293.879799:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847293.879807:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595339392:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847293.879833:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595339392:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847293.879840:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847293.879851:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1787847293.879856:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595339520:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847293.879876:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595339520:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 20us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847293.879882:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00080000:3.0:1787847293.879896:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847293.879900:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787847293.879903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847293.880368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339136 00000100:00100000:2.0:1787847293.880373:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339136 00000100:00100000:2.0:1787847293.880417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 193 00000100:00100000:2.0:1787847293.880425:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595339136:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847293.880463:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595339136:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 39us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847293.880482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 193 00010000:00010000:0.0:1787847294.426949:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847295.454456:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847296.091458:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616342016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847296.091553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847296.091647:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342016 00000100:00100000:1.0:1787847296.091656:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342016 00000100:00100000:1.0:1787847296.091725:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787847296.091735:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616342016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847296.091776:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847296.091822:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616342016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847296.091829:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787847296.091870:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce2d00 x1874693616342016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847296.091890:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616342016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787847296.095705:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787847296.472510:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847297.495263:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847297.623371:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616342528:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.623477:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847297.623548:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847297.623555:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616342144:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.623664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847297.623691:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616342656:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.623720:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847297.623750:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616342272:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.623776:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847297.623796:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616342784:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.623819:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847297.623839:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847297.623844:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616342400:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.623866:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847297.625978:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342528 00000100:00100000:3.0:1787847297.625996:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342528 00000100:00100000:3.0:1787847297.626060:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342784 00000100:00100000:3.0:1787847297.626064:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342784 00000100:00100000:3.0:1787847297.626101:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787847297.626113:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616342528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.626234:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616342528:12345-0@lo:400:kworker.0 Request processed in 122us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847297.626241:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787847297.626261:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847297.626267:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616342784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.626376:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616342784:12345-0@lo:400:kworker.0 Request processed in 108us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847297.626395:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847297.626418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342144 00000100:00100000:3.0:1787847297.626421:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342144 00000100:00100000:3.0:1787847297.626451:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787847297.626458:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616342144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.626494:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616342144:12345-0@lo:400:kworker.0 Request processed in 36us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847297.626500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1787847297.626537:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342656 00000100:00100000:3.0:1787847297.626541:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342656 00000100:00100000:3.0:1787847297.626570:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342272 00000100:00100000:3.0:1787847297.626573:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342272 00000100:00100000:3.0:1787847297.626658:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342400 00000100:00100000:3.0:1787847297.626662:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342400 00000100:00100000:3.0:1787847297.626678:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787847297.626685:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616342656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.626719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12be1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616342656:12345-0@lo:400:kworker.0 Request processed in 34us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847297.626725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787847297.626738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787847297.626743:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616342272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.626771:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616342272:12345-0@lo:400:kworker.0 Request processed in 28us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847297.626776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787847297.626786:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787847297.626792:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616342400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.626849:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616342400:12345-0@lo:400:kworker.0 Request processed in 57us (2981us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847297.626856:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787847297.626927:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847297.626963:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847297.627028:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616342400:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.627044:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616342272:0@lo:400:kworker.0 00010000:00080000:3.0:1787847297.627060:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bd9a40 x1874693616342784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847297.627072:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616342784:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.627116:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bda1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616342144:0@lo:400:kworker.0 00000100:00100000:3.0:1787847297.627128:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616342656:0@lo:400:kworker.0 00010000:00080000:3.0:1787847297.627143:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bd92c0 x1874693616342528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847297.627152:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616342528:0@lo:400:kworker.0 00000100:00100000:3.0:1787847298.138436:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847298.138468:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616342912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847298.138567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847298.138657:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616342912 00000100:00100000:3.0:1787847298.138665:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616342912 00000100:00100000:3.0:1787847298.140462:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787847298.140486:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616342912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847298.140534:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847298.140634:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616342912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (2067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847298.140643:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787847298.140702:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bd92c0 x1874693616342912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847298.140871:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616342912:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787847298.191518:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1787847298.519806:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847298.994716:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847298.994768:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847298.994798:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847298.994825:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339648 00000100:00100000:3.0:1787847298.994835:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339648 00000100:00100000:3.0:1787847298.994885:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:3.0:1787847298.994895:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595339648:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847298.994983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595339648:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 89us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847298.994990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:3.0:1787847298.995021:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340032 00000100:00100000:3.0:1787847298.995025:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340032 00000100:00100000:3.0:1787847298.995060:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1787847298.995067:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2347:x1874693595340032:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847298.995094:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2347:x1874693595340032:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847298.995100:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00080000:3.0:1787847298.995227:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787847298.995402:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339776 00000100:00100000:1.0:1787847298.995407:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339776 00000100:00100000:1.0:1787847298.995454:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:1.0:1787847298.995462:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595339776:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847298.995509:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bda1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595339776:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 49us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847298.995523:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1787847298.996002:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847298.996074:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595339904 00000100:00100000:3.0:1787847298.996079:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595339904 00000100:00100000:3.0:1787847298.996108:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1787847298.996114:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595339904:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847298.996156:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595339904:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847298.996163:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00080000:3.0:1787847298.996182:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787847298.996185:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787847299.543120:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847300.570315:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847301.217132:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616343040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847301.217233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847301.224127:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343040 00000100:00100000:2.0:1787847301.224149:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343040 00000100:00100000:2.0:1787847301.224240:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787847301.224253:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616343040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847301.224304:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847301.224394:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616343040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (7163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847301.224399:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787847301.224550:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f370c0 x1874693616343040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847301.224574:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616343040:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787847301.224706:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787847301.591321:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847302.615730:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847302.743369:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616343552:0@lo:400:kworker.0 00000100:00100000:1.0:1787847302.743444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847302.743585:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616343168:0@lo:400:kworker.0 00000100:00100000:2.0:1787847302.743622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847302.743686:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616343296:0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.743720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847302.755200:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616343808:0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.755296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847302.755352:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847302.755360:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616343424:0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.755388:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847302.755433:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343552 00000100:00100000:3.0:1787847302.755441:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343552 00000100:00100000:3.0:1787847302.755496:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343808 00000100:00100000:3.0:1787847302.755500:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343808 00000100:00100000:3.0:1787847302.755530:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787847302.755538:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616343552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.755595:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616343552:12345-0@lo:400:kworker.0 Request processed in 57us (12150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847302.755602:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787847302.755627:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787847302.755633:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616343808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.755667:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616343808:12345-0@lo:400:kworker.0 Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847302.755672:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787847302.755692:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343168 00000100:00100000:3.0:1787847302.755696:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343168 00000100:00100000:3.0:1787847302.756821:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787847302.756832:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616343168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.756883:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616343168:12345-0@lo:400:kworker.0 Request processed in 53us (13260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847302.756889:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787847302.756921:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343296 00000100:00100000:3.0:1787847302.756925:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343296 00000100:00100000:3.0:1787847302.756968:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343424 00000100:00100000:3.0:1787847302.756971:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343424 00000100:00100000:3.0:1787847302.756987:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787847302.757114:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616343296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.757150:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616343296:12345-0@lo:400:kworker.0 Request processed in 39us (13428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847302.757156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787847302.757168:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787847302.757174:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616343424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.757201:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616343424:12345-0@lo:400:kworker.0 Request processed in 27us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847302.757206:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1787847302.757230:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847302.757243:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787847302.757286:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce2580 x1874693616343552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847302.757302:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616343552:0@lo:400:kworker.0 00000100:00100000:2.0:1787847302.759341:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616343168:0@lo:400:kworker.0 00000100:00100000:2.0:1787847302.759356:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616343680:0@lo:400:kworker.0 00000100:00100000:2.0:1787847302.759412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847302.760804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343680 00000100:00100000:1.0:1787847302.760815:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343680 00000100:00100000:1.0:1787847302.760878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787847302.760889:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616343680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847302.760983:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616343680:12345-0@lo:400:kworker.0 Request processed in 96us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847302.761076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1787847302.761111:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847302.761144:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616343680:0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.762138:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616343424:0@lo:400:kworker.0 00000100:00100000:3.0:1787847302.762153:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616343296:0@lo:400:kworker.0 00010000:00080000:3.0:1787847302.762166:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce0780 x1874693616343808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847318 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847302.762177:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616343808:0@lo:400:kworker.0 00000001:02000400:0.0:1787847303.090840:0:9041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing yml_node 00000100:00100000:0.0:1787847303.256170:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847303.256191:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616343936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847303.256267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847303.256606:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616343936 00000100:00100000:1.0:1787847303.256614:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616343936 00000100:00100000:1.0:1787847303.256662:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787847303.256671:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616343936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847303.256703:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847303.256751:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616343936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847303.256758:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787847303.258836:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880052f0c0 x1874693616343936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847303.258863:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616343936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787847303.639158:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847304.130368:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847304.130560:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340160 00000100:00100000:1.0:1787847304.130574:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340160 00000100:00100000:1.0:1787847304.130659:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:1.0:1787847304.130672:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595340160:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847304.130789:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595340160:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 120us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847304.130806:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:0.0:1787847304.146072:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847304.146129:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847304.146165:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847304.146202:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340416 00000100:00100000:0.0:1787847304.146212:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340416 00000100:00100000:0.0:1787847304.148217:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340544 00000100:00100000:0.0:1787847304.148226:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340544 00000100:00100000:0.0:1787847304.148251:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1787847304.148261:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2343:x1874693595340416:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:0.0:1787847304.148292:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861b48 00000100:00080000:0.0:1787847304.148301:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8d87ff955000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787847304.148336:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787847304.148703:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+2:2343:x1874693595340416:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 443us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847304.148712:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1787847304.148728:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:0.0:1787847304.148734:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2343:x1874693595340544:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:0.0:1787847304.148748:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861b4f 00000100:00080000:0.0:1787847304.148754:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8d87ff952000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787847304.148776:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787847304.149049:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+2:2343:x1874693595340544:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 314us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847304.149068:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00080000:0.0:1787847304.149093:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847304.149097:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787847304.149162:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847304.150142:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340288 00000100:00100000:2.0:1787847304.150160:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340288 00000100:00080000:0.0:1787847304.150196:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847304.150249:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:2.0:1787847304.150261:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595340288:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847304.150345:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595340288:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 85us (4298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847304.150354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00010000:00010000:2.0:1787847304.150386:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847304.663277:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847305.687158:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847306.327576:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847306.327623:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616344064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847306.327719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847306.328179:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344064 00000100:00100000:2.0:1787847306.328189:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344064 00000100:00100000:2.0:1787847306.332419:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1787847306.332420:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847306.332446:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616344064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847306.332516:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847306.332649:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616344064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 214us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847306.332658:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787847306.332763:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f370c0 x1874693616344064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847306.332794:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616344064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787847306.714170:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787847307.023539:0:9233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.87 00000001:00100000:3.0:1787847307.437635:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:3.0:1787847307.437645:0:7632:0:(genops.c:885:class_export_put()) final put ffff8d87ff957800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:2.0:1787847307.437707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ff957800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 for lustre-OST0001 00000020:00000080:2.0:1787847307.437776:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87ff952000 for lustre-OST0001 00010000:00010000:1.0:1787847307.736174:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847307.864089:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616344192:0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.864134:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616344320:0@lo:400:kworker.0 00000100:00100000:3.0:1787847307.864235:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616344576:0@lo:400:kworker.0 00000100:00100000:0.0:1787847307.868044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847307.868058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847307.868572:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616344704:0@lo:400:kworker.0 00000100:00100000:0.0:1787847307.868628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847307.870153:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616344448:0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.870199:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616344832:0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.870256:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847307.870327:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344320 00000100:00100000:1.0:1787847307.870336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344320 00000100:00100000:1.0:1787847307.870389:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344704 00000100:00100000:1.0:1787847307.870392:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344704 00000100:00100000:1.0:1787847307.870429:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787847307.870438:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616344320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.870507:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616344320:12345-0@lo:400:kworker.0 Request processed in 69us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847307.870515:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787847307.870543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787847307.870550:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616344704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.870588:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616344704:12345-0@lo:400:kworker.0 Request processed in 38us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847307.870594:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787847307.870617:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344832 00000100:00100000:1.0:1787847307.870621:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344832 00000100:00100000:1.0:1787847307.870651:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787847307.870658:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616344832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.870690:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616344832:12345-0@lo:400:kworker.0 Request processed in 32us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847307.870696:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787847307.870749:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616344320:0@lo:400:kworker.0 00010000:00080000:1.0:1787847307.870764:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce2580 x1874693616344832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847307.870776:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616344832:0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.870816:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616344704:0@lo:400:kworker.0 00000100:00100000:0.0:1787847307.870897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847307.871032:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344192 00000100:00100000:3.0:1787847307.871038:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344192 00000100:00100000:3.0:1787847307.871077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787847307.871086:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616344192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847307.871202:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616344192:12345-0@lo:400:kworker.0 Request processed in 118us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847307.871210:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:3.0:1787847307.871283:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847307.871288:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847307.871385:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616344192:0@lo:400:kworker.0 00000100:00100000:3.0:1787847307.871423:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847307.871449:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344576 00000100:00100000:3.0:1787847307.871452:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344576 00000100:00100000:3.0:1787847307.871477:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787847307.871497:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616344576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847307.871530:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616344576:12345-0@lo:400:kworker.0 Request processed in 47us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847307.871536:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787847307.871567:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce30c0 x1874693616344576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847307.871578:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616344576:0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.871680:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344448 00000100:00100000:1.0:1787847307.871684:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344448 00000100:00100000:1.0:1787847307.873208:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787847307.873224:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616344448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847307.873308:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616344448:12345-0@lo:400:kworker.0 Request processed in 90us (2411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847307.873315:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787847307.873737:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847307.874065:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616344448:0@lo:400:kworker.0 00000100:00100000:0.0:1787847308.375155:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847308.375187:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616344960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847308.375282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847308.375375:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616344960 00000100:00100000:0.0:1787847308.375384:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616344960 00000100:00100000:0.0:1787847308.375445:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787847308.375456:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616344960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847308.375516:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847308.375573:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616344960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847308.375582:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787847308.375633:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880052e940 x1874693616344960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847308.375655:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616344960:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787847308.447707:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:3.0:1787847308.447717:0:6706:0:(genops.c:885:class_export_put()) final put ffff8d87ff951800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:0.0:1787847308.451706:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ff951800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 for lustre-OST0000 00000020:00000080:0.0:1787847308.451772:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87ff955000 for lustre-OST0000 00010000:00010000:3.0:1787847308.760652:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787847309.019877:0:9333:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.87 00000100:00100000:0.0:1787847309.237447:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847309.237534:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847309.237671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340800 00000100:00100000:1.0:1787847309.237694:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340800 00000100:00100000:1.0:1787847309.237782:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1787847309.237795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595340800:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847309.237870:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595340800:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847309.237877:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00080000:2.0:1787847309.238350:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847309.238416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340672 00000100:00100000:3.0:1787847309.238422:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340672 00000100:00100000:3.0:1787847309.238561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 199 00000100:00100000:3.0:1787847309.238569:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595340672:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847309.238619:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595340672:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 51us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847309.238626:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 199 00010000:00010000:0.0:1787847309.787366:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847310.809545:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847311.447446:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616345088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847311.447534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847311.447736:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345088 00000100:00100000:0.0:1787847311.447745:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345088 00000100:00100000:0.0:1787847311.447816:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787847311.447841:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616345088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847311.447878:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847311.447960:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616345088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847311.447971:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787847311.447975:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787847311.448094:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f36d00 x1874693616345088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847311.448122:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616345088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787847311.831197:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787847312.012195:0:9431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.87 00010000:00010000:3.0:1787847312.855597:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847312.983532:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616345472:0@lo:400:kworker.0 00000100:00100000:0.0:1787847312.983791:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616345344:0@lo:400:kworker.0 00000100:00100000:0.0:1787847312.983834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847312.983962:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616345856:0@lo:400:kworker.0 00000100:00100000:0.0:1787847312.983996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847312.984056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345344 00000100:00100000:0.0:1787847312.984067:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345344 00000100:00100000:0.0:1787847312.984128:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787847312.984139:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616345344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847312.984216:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616345344:12345-0@lo:400:kworker.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847312.984355:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787847312.984414:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616345344:0@lo:400:kworker.0 00000100:00100000:2.0:1787847312.984775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847312.985163:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616345600:0@lo:400:kworker.0 00000100:00100000:1.0:1787847312.985165:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616345216:0@lo:400:kworker.0 00000100:00100000:3.0:1787847312.985215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847312.985217:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847312.985293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345472 00000100:00100000:3.0:1787847312.985300:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345472 00000100:00100000:1.0:1787847312.985371:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616345728:0@lo:400:kworker.0 00000100:00100000:1.0:1787847312.985398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847312.985836:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345856 00000100:00100000:1.0:1787847312.985841:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345856 00000100:00100000:1.0:1787847312.985885:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345600 00000100:00100000:1.0:1787847312.986009:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345600 00000100:00100000:1.0:1787847312.986041:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787847312.986050:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616345856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847312.986110:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616345856:12345-0@lo:400:kworker.0 Request processed in 62us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847312.986117:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787847312.986133:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787847312.986139:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616345600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847312.986186:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616345600:12345-0@lo:400:kworker.0 Request processed in 47us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847312.986192:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787847312.986213:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345216 00000100:00100000:1.0:1787847312.986217:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345216 00000100:00100000:1.0:1787847312.986275:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787847312.986281:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847312.986334:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616345216:12345-0@lo:400:kworker.0 Request processed in 52us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847312.986340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1787847312.991595:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847312.991611:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847312.998577:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345728 00000100:00100000:3.0:1787847312.998596:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345728 00000100:00080000:3.0:1787847312.998642:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847312.998682:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787847312.998694:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616345472:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787847312.998853:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a9680 x1874693616345600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847312.998875:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616345600:0@lo:400:kworker.0 00010000:00080000:2.0:1787847312.999800:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007a92c0 x1874693616345856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847312.999814:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616345856:0@lo:400:kworker.0 00000100:00100000:3.0:1787847313.000547:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616345472:12345-0@lo:400:kworker.0 Request processed in 1853us (15769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847313.000559:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787847313.000617:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616345472:0@lo:400:kworker.0 00000100:00100000:3.0:1787847313.000648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787847313.001193:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616345216:0@lo:400:kworker.0 00000100:00100000:3.0:1787847313.001839:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616345728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847313.002597:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616345728:12345-0@lo:400:kworker.0 Request processed in 770us (17195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847313.002885:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616345728:0@lo:400:kworker.0 00000100:00100000:3.0:1787847313.009558:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787847313.496847:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847313.496890:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616345984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847313.497045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847313.497140:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616345984 00000100:00100000:1.0:1787847313.497162:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616345984 00000100:00100000:1.0:1787847313.497239:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787847313.497251:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616345984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847313.497300:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847313.497355:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616345984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847313.497363:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787847313.497626:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880052de00 x1874693616345984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847313.497655:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616345984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787847313.879459:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787847314.169096:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Aug 27 12:15:12 EDT 2026 00000100:00100000:0.0:1787847314.352907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847314.352990:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847314.353033:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341056 00000100:00100000:0.0:1787847314.353046:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341056 00000100:00100000:0.0:1787847314.353127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:0.0:1787847314.353141:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595341056:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847314.353245:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595341056:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 107us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847314.353265:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1787847314.353632:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595340928 00000100:00100000:3.0:1787847314.353639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595340928 00000100:00100000:3.0:1787847314.353675:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:3.0:1787847314.353683:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595340928:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847314.353736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595340928:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 54us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847314.353746:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00080000:3.0:1787847314.353781:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787847314.904116:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847315.936722:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847316.567194:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616346112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787847316.567294:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847316.567444:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346112 00000100:00100000:2.0:1787847316.567464:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346112 00000100:00100000:2.0:1787847316.567560:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787847316.567571:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616346112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847316.567619:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847316.567673:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616346112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847316.567681:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787847316.568503:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b1e00 x1874693616346112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847316.568547:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616346112:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787847316.569070:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787847316.960348:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847317.975334:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847318.109043:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616346624:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.109219:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787847318.109226:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616346240:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.109298:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616346752:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.109388:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616346368:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109417:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.109441:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847318.109447:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616346496:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.109560:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346624 00000100:00100000:0.0:1787847318.109571:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346624 00000100:00100000:0.0:1787847318.109643:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787847318.109654:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616346624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109727:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616346624:12345-0@lo:400:kworker.0 Request processed in 74us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.109735:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787847318.109762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346240 00000100:00100000:0.0:1787847318.109766:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346240 00000100:00100000:0.0:1787847318.109792:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787847318.109798:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616346240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.109843:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616346240:12345-0@lo:400:kworker.0 Request processed in 44us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.109849:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787847318.109877:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346752 00000100:00100000:0.0:1787847318.109882:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346752 00000100:00100000:0.0:1787847318.109910:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346368 00000100:00100000:0.0:1787847318.109913:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346368 00000100:00100000:0.0:1787847318.109926:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346496 00000100:00100000:0.0:1787847318.109955:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346496 00000100:00100000:0.0:1787847318.109975:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787847318.109982:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616346752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110015:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616346752:12345-0@lo:400:kworker.0 Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.110022:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787847318.110033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787847318.110039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616346368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110071:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616346368:12345-0@lo:400:kworker.0 Request processed in 31us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.110077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787847318.110089:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787847318.110107:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616346496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110137:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616346496:12345-0@lo:400:kworker.0 Request processed in 32us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.110143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787847318.110206:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787847318.110212:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847318.110246:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616346240:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110262:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616346752:0@lo:400:kworker.0 00010000:00080000:0.0:1787847318.110277:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f370c0 x1874693616346624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847318.110288:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616346624:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110333:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616346496:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110344:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616346368:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110390:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616346880:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.110457:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616346880 00000100:00100000:0.0:1787847318.110462:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616346880 00000100:00100000:0.0:1787847318.110498:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787847318.110505:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616346880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.110541:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616346880:12345-0@lo:400:kworker.0 Request processed in 37us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.110547:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787847318.110561:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787847318.110578:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e1360780 x1874693616346880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847318.110597:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1360780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616346880:0@lo:400:kworker.0 00000100:00100000:0.0:1787847318.623954:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616347008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847318.624708:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847318.624844:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347008 00000100:00100000:0.0:1787847318.624855:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347008 00000100:00100000:0.0:1787847318.624918:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787847318.624961:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616347008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847318.625008:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847318.625133:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616347008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847318.625141:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787847318.625194:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c6b06d00 x1874693616347008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847318.625217:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b06d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616347008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787847319.001367:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847319.474249:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847319.474319:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847319.474365:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341312 00000100:00100000:1.0:1787847319.474378:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341312 00000100:00100000:1.0:1787847319.474463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:1.0:1787847319.474478:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595341312:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847319.474602:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595341312:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 129us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847319.474611:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00080000:1.0:1787847319.474639:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847319.474927:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341184 00000100:00100000:2.0:1787847319.474962:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341184 00000100:00100000:2.0:1787847319.474998:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:2.0:1787847319.475006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595341184:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847319.475054:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595341184:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 49us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847319.475061:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 203 00010000:00010000:0.0:1787847320.023454:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847321.048279:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847321.690173:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847321.690204:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616347136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847321.690456:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847321.690569:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347136 00000100:00100000:0.0:1787847321.690579:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347136 00000100:00100000:0.0:1787847321.690653:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787847321.690665:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616347136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847321.690711:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847321.690783:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616347136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847321.690792:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787847321.690863:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce2580 x1874693616347136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847321.690886:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616347136:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787847321.690970:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787847322.072344:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847323.096585:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847323.224090:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616347392:0@lo:400:kworker.0 00000100:00100000:2.0:1787847323.224120:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616347648:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.224216:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616347264:0@lo:400:kworker.0 00000100:00100000:2.0:1787847323.228404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847323.241261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847323.241286:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347648 00000100:00100000:2.0:1787847323.241304:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347648 00000100:00100000:0.0:1787847323.241355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347392 00000100:00100000:0.0:1787847323.241365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347392 00000100:00100000:2.0:1787847323.241404:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787847323.241424:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616347648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847323.241442:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787847323.241455:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616347392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847323.241557:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616347648:12345-0@lo:400:kworker.0 Request processed in 140us (13160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847323.241566:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787847323.241601:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616347520:0@lo:400:kworker.0 00000100:00100000:2.0:1787847323.241659:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787847323.242108:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b03c0 x1874693616347648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847323.242138:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616347648:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.242626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847323.242845:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616347776:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.242878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787847323.242911:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847323.242926:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347520 00000100:00100000:1.0:1787847323.242947:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347520 00000100:00100000:1.0:1787847323.242980:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347776 00000100:00100000:1.0:1787847323.242983:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347776 00000100:00100000:1.0:1787847323.243000:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787847323.243007:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616347520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.243050:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616347520:12345-0@lo:400:kworker.0 Request processed in 43us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847323.243057:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787847323.243070:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787847323.243077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616347776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.243118:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616347776:12345-0@lo:400:kworker.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847323.243124:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787847323.243141:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847323.243286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347264 00000100:00100000:2.0:1787847323.243290:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347264 00000100:00100000:2.0:1787847323.243317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787847323.243324:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616347264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847323.243356:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616347264:12345-0@lo:400:kworker.0 Request processed in 32us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847323.243362:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787847323.243403:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616347520:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.243991:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616347264:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.244004:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616347776:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.251876:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616347392:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.251898:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616347904:0@lo:400:kworker.0 00000100:00100000:1.0:1787847323.251996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847323.252106:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616347904 00000100:00100000:2.0:1787847323.252118:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616347904 00000100:00100000:2.0:1787847323.252191:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787847323.252200:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616347904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847323.252284:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616347904:12345-0@lo:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847323.252289:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787847323.252330:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b1680 x1874693616347904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847323.252341:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616347904:0@lo:400:kworker.0 00000100:00080000:1.0:1787847323.253855:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847323.257251:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616347392:12345-0@lo:400:kworker.0 Request processed in 15782us (15987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847323.257273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787847323.735089:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847323.735133:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616348032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847323.735229:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847323.735327:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348032 00000100:00100000:0.0:1787847323.735336:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348032 00000100:00100000:0.0:1787847323.735394:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787847323.735403:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616348032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847323.735447:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847323.735500:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616348032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847323.735508:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787847323.735561:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c6b05e00 x1874693616348032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847323.735584:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616348032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787847324.119321:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847324.597406:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847324.597468:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847324.597565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341568 00000100:00100000:3.0:1787847324.597579:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341568 00000100:00100000:3.0:1787847324.597667:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:3.0:1787847324.597679:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595341568:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847324.597786:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595341568:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847324.597795:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:0.0:1787847324.598249:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341440 00000100:00100000:0.0:1787847324.598256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341440 00000100:00100000:0.0:1787847324.598307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:0.0:1787847324.598318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595341440:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847324.598360:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595341440:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 45us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847324.598367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00080000:1.0:1787847324.598823:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787847325.143620:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847326.167401:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847326.809126:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847326.809159:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616348160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787847326.809260:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847326.809348:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348160 00000100:00100000:0.0:1787847326.809360:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348160 00000100:00100000:0.0:1787847326.809438:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787847326.809453:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616348160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847326.809503:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847326.809559:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616348160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847326.809567:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787847326.809594:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787847326.809633:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c6b04b40 x1874693616348160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847326.809656:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b04b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616348160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787847327.192805:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847328.215782:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847328.345012:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616348672:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.345150:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847328.345156:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616348288:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345184:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.345206:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616348800:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345227:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.345257:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616348544:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345280:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.345296:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787847328.345301:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616348416:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345339:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.345356:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616348928:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.345403:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348672 00000100:00100000:3.0:1787847328.345410:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348672 00000100:00100000:3.0:1787847328.345467:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348928 00000100:00100000:3.0:1787847328.345470:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348928 00000100:00100000:3.0:1787847328.345494:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787847328.345503:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616348672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345555:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616348672:12345-0@lo:400:kworker.0 Request processed in 53us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.345563:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787847328.345580:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787847328.345585:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616348928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345612:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616348928:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.345617:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787847328.345668:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348288 00000100:00100000:3.0:1787847328.345672:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348288 00000100:00100000:3.0:1787847328.345698:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787847328.345704:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616348288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616348288:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.345737:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787847328.345762:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348800 00000100:00100000:3.0:1787847328.345765:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348800 00000100:00100000:3.0:1787847328.345788:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348544 00000100:00100000:3.0:1787847328.345796:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348544 00000100:00100000:3.0:1787847328.345812:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616348416 00000100:00100000:3.0:1787847328.345815:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616348416 00000100:00100000:3.0:1787847328.345828:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787847328.345833:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616348800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345860:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616348800:12345-0@lo:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.345866:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787847328.345876:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787847328.345882:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616348544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345907:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616348544:12345-0@lo:400:kworker.0 Request processed in 25us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.345911:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787847328.345920:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787847328.345926:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616348416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.345974:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616348416:12345-0@lo:400:kworker.0 Request processed in 48us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.345979:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787847328.346032:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616348416:0@lo:400:kworker.0 00010000:00080000:3.0:1787847328.346045:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b1a40 x1874693616348928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847328.346054:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616348928:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.346062:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616348544:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.346101:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616348288:0@lo:400:kworker.0 00000100:00100000:3.0:1787847328.346122:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616348800:0@lo:400:kworker.0 00010000:00080000:3.0:1787847328.346131:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b0f00 x1874693616348672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847328.346140:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616348672:0@lo:400:kworker.0 00000100:00080000:0.0:1787847328.352124:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787847328.352135:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847328.352138:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847328.855831:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847328.855852:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616349056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847328.855918:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847328.856104:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349056 00000100:00100000:3.0:1787847328.856110:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349056 00000100:00100000:3.0:1787847328.856156:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787847328.856163:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616349056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847328.856192:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847328.856229:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616349056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847328.856234:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787847328.856262:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b0f00 x1874693616349056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847328.856276:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616349056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847329.239192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847329.711435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847329.713211:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341824 00000100:00100000:1.0:1787847329.713226:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341824 00000100:00100000:1.0:1787847329.713335:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1787847329.713352:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595341824:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847329.713457:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595341824:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 112us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847329.713480:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00080000:0.0:1787847329.713577:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847329.719626:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847329.719719:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341696 00000100:00100000:2.0:1787847329.719729:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341696 00000100:00100000:2.0:1787847329.719787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 207 00000100:00100000:2.0:1787847329.719797:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595341696:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847329.719888:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2344:x1874693595341696:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847329.719906:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 207 00010000:00010000:1.0:1787847330.263259:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787847330.855424:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 12:15:29 (1787847329) === 00010000:00010000:1.0:1787847331.287421:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847331.334325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847331.334499:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595341952 00000100:00100000:0.0:1787847331.334508:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595341952 00000100:00100000:0.0:1787847331.334569:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:0.0:1787847331.334612:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:8108:x1874693595341952:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787847331.334630:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847331.334649:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff000/0x1835de88b9861c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b66 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847331.334678:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff000/0x1835de88b9861c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b66 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847331.334689:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff000/0x1835de88b9861c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b66 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847331.334700:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff000, rc 0) 00000100:00100000:0.0:1787847331.334764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8108:x1874693595341952:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 185us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847331.334772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:0.0:1787847331.343905:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847331.344082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342080 00000100:00100000:3.0:1787847331.344093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342080 00000100:00100000:3.0:1787847331.344161:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:3.0:1787847331.344171:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8108:x1874693595342080:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787847331.344516:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8108:x1874693595342080:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 345us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847331.344534:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:3.0:1787847331.353396:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.353552:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342208 00000100:00100000:2.0:1787847331.353562:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342208 00000100:00100000:2.0:1787847331.353639:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:2.0:1787847331.353650:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8108:x1874693595342208:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787847331.353886:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8108:x1874693595342208:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 238us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.353894:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:2.0:1787847331.360805:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847331.361030:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342336 00000100:00100000:0.0:1787847331.361042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342336 00000100:00100000:0.0:1787847331.361100:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:0.0:1787847331.361281:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8112:x1874693595342336:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787847331.361645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8112:x1874693595342336:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 535us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847331.361653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:0.0:1787847331.390326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847331.390418:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342464 00000100:00100000:3.0:1787847331.390428:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342464 00000100:00100000:3.0:1787847331.390539:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:3.0:1787847331.390550:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8112:x1874693595342464:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787847331.390856:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8112:x1874693595342464:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 307us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847331.390864:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:1.0:1787847331.403564:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847331.403663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342592 00000100:00100000:0.0:1787847331.403673:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342592 00000100:00100000:0.0:1787847331.403736:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:0.0:1787847331.403746:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:8108:x1874693595342592:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787847331.403764:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847331.403784:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6afe000/0x1835de88b9861c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b90 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847331.403816:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afe000/0x1835de88b9861c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b90 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847331.403826:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6afe000/0x1835de88b9861c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b90 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847331.403836:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe000, rc 0) 00000100:00100000:0.0:1787847331.403896:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:8108:x1874693595342592:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 151us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847331.403903:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:0.0:1787847331.419883:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847331.419966:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342720 00000100:00100000:3.0:1787847331.419975:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342720 00000100:00100000:3.0:1787847331.420028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:3.0:1787847331.420037:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:8108:x1874693595342720:12345-192.168.201.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787847331.420061:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787847331.420083:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787847331.420087:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787847331.420090:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787847331.420092:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787847331.423266:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:8108:x1874693595342720:12345-192.168.201.21@tcp:256:mount.lustre.0 Request processed in 3217us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.423283:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:1.0:1787847331.426872:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.427030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342848 00000100:00100000:2.0:1787847331.427040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342848 00000100:00100000:2.0:1787847331.427098:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:2.0:1787847331.427108:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:8108:x1874693595342848:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787847331.427126:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847331.427143:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0b97 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847331.427170:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847331.427180:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847331.427207:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ba00, rc 0) 00000100:00100000:2.0:1787847331.427272:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8108:x1874693595342848:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 165us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.427278:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:1.0:1787847331.432120:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.432255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595342976 00000100:00100000:2.0:1787847331.432264:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595342976 00000100:00100000:2.0:1787847331.432366:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:2.0:1787847331.432377:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8108:x1874693595342976:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787847331.432719:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8108:x1874693595342976:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 342us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.432726:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:0.0:1787847331.435459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.435535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343104 00000100:00100000:2.0:1787847331.435543:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343104 00000100:00100000:2.0:1787847331.435662:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 217 00000100:00100000:2.0:1787847331.435672:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8108:x1874693595343104:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787847331.435922:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8108:x1874693595343104:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 250us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.435950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 217 00000100:00100000:1.0:1787847331.440531:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.440636:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343232 00000100:00100000:2.0:1787847331.440646:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343232 00000100:00100000:2.0:1787847331.440725:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:2.0:1787847331.440735:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8115:x1874693595343232:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787847331.441201:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8115:x1874693595343232:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 466us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.441219:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:1.0:1787847331.457535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.457641:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343360 00000100:00100000:2.0:1787847331.457652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343360 00000100:00100000:2.0:1787847331.457711:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 219 00000100:00100000:2.0:1787847331.457722:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8115:x1874693595343360:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787847331.458073:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:8115:x1874693595343360:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 352us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.458081:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 219 00000100:00100000:0.0:1787847331.466807:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847331.466861:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847331.466993:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343872 00000100:00100000:3.0:1787847331.467005:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343872 00000100:00100000:3.0:1787847331.467094:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343488 00000100:00100000:3.0:1787847331.467098:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343488 00000100:00080000:0.0:1787847331.467258:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847331.467329:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:2.0:1787847331.467343:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595343872:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847331.467428:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595343872:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 89us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.467435:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:3.0:1787847331.468713:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1787847331.468723:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2343:x1874693595343488:12345-192.168.201.21@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787847331.468754:0:5845:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from 4cd94325-5cad-4012-9431-9a61496a2886@192.168.201.21@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1787847331.468797:0:5845:0:(genops.c:1385:class_connect()) connect: client 4cd94325-5cad-4012-9431-9a61496a2886, cookie 0x1835de88b9861c28 00000004:00100000:3.0:1787847331.468843:0:5845:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787847331.469365:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8d88007a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787847331.469422:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+6:2343:x1874693595343488:12345-192.168.201.21@tcp:38:mount.lustre.0 Request processed in 698us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847331.469431:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1787847331.480158:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847331.480298:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343616 00000100:00100000:2.0:1787847331.480308:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343616 00000100:00100000:2.0:1787847331.480393:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1787847331.480404:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:0:x1874693595343616:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787847331.480459:0:7214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787847331.480563:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:0:x1874693595343616:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 160us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.480571:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00080000:0.0:1787847331.480645:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847331.483374:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847331.483492:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595343744 00000100:00100000:0.0:1787847331.483501:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595343744 00000100:00100000:0.0:1787847331.483563:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:0.0:1787847331.483573:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+6:8108:x1874693595343744:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787847331.483634:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787847331.483715:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+6:8108:x1874693595343744:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 142us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847331.483723:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1787847331.492477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847331.493108:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344000 00000100:00100000:1.0:1787847331.493118:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344000 00000100:00100000:1.0:1787847331.493193:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1787847331.493204:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:8108:x1874693595344000:12345-192.168.201.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787847331.493300:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:8108:x1874693595344000:12345-192.168.201.21@tcp:40:mount.lustre.0 Request processed in 97us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847331.493306:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1787847331.497490:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847331.497538:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847331.497701:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344128 00000100:00100000:3.0:1787847331.497711:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344128 00000100:00100000:3.0:1787847331.497760:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344256 00000100:00100000:3.0:1787847331.497763:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344256 00000100:00100000:3.0:1787847331.497787:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1787847331.497796:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874693595344128:12345-192.168.201.21@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787847331.497827:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00010000:00080000:3.0:1787847331.497833:0:6678:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 4cd94325-5cad-4012-9431-9a61496a2886@192.168.201.21@tcp t0 exp 0000000000000000 cur 246 last 0 00000100:00100000:2.0:1787847331.497838:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874693595344256:12345-192.168.201.21@tcp:8:mount.lustre.0 00000020:00000080:3.0:1787847331.497872:0:6678:0:(genops.c:1385:class_connect()) connect: client 4cd94325-5cad-4012-9431-9a61496a2886, cookie 0x1835de88b9861c2f 00002000:00100000:3.0:1787847331.497886:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4cd94325-5cad-4012-9431-9a61496a2886/ffff8d88007a3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:2.0:1787847331.497888:0:6677:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 4cd94325-5cad-4012-9431-9a61496a2886@192.168.201.21@tcp t0 exp 0000000000000000 cur 246 last 0 00002000:00100000:3.0:1787847331.497917:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:2.0:1787847331.497917:0:6677:0:(genops.c:1385:class_connect()) connect: client 4cd94325-5cad-4012-9431-9a61496a2886, cookie 0x1835de88b9861c36 00002000:00100000:2.0:1787847331.497925:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4cd94325-5cad-4012-9431-9a61496a2886/ffff8d880056c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787847331.497972:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787847331.498271:0:6677:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787847331.498307:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8d8800569000 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1787847331.498362:0:6678:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787847331.498387:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8d88007a5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847331.498404:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4cd94325-5cad-4012-9431-9a61496a2886+6:2343:x1874693595344256:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 565us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847331.498414:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1787847331.498425:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4cd94325-5cad-4012-9431-9a61496a2886+6:2343:x1874693595344128:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 627us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847331.498437:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1787847331.512760:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847331.514356:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344384 00000100:00100000:3.0:1787847331.514370:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344384 00000100:00100000:3.0:1787847331.514445:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:3.0:1787847331.514457:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4cd94325-5cad-4012-9431-9a61496a2886+6:8108:x1874693595344384:12345-192.168.201.21@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787847331.514761:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787847331.514968:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4cd94325-5cad-4012-9431-9a61496a2886+6:8108:x1874693595344384:12345-192.168.201.21@tcp:33:mount.lustre.0 Request processed in 512us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847331.514976:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1787847331.929067:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847331.930657:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616349184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847331.930736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847331.931746:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349184 00000100:00100000:3.0:1787847331.931757:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349184 00000100:00100000:3.0:1787847331.931826:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787847331.931836:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616349184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847331.931863:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847331.931972:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616349184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847331.931989:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787847331.932156:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b12c0 x1874693616349184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787847331.936756:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847331.937279:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616349184:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787847332.311512:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787847333.026604:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4cd94325-5cad-4012-9431-9a61496a2886 00010000:00010000:1.0:1787847333.337834:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847333.480856:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616349312:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.480960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847333.481037:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349312 00000100:00100000:2.0:1787847333.481045:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349312 00000100:00100000:2.0:1787847333.481095:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787847333.481106:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616349312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.481159:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616349312:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847333.481167:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787847333.481218:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616349312:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.481266:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616349440:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.481615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847333.481670:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847333.481676:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616349568:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.481700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847333.481726:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349440 00000100:00100000:2.0:1787847333.481730:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349440 00000100:00100000:2.0:1787847333.481755:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349568 00000100:00100000:2.0:1787847333.481759:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349568 00000100:00100000:2.0:1787847333.481893:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787847333.481901:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.481971:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616349440:12345-0@lo:400:kworker.0 Request processed in 71us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847333.481978:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787847333.481990:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787847333.481995:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616349568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.482020:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616349568:12345-0@lo:400:kworker.0 Request processed in 25us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847333.482025:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787847333.482050:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616349568:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.482059:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616349440:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.482089:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787847333.482096:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616349696:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.482122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847333.482159:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616349824:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.482181:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847333.482709:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349824 00000100:00100000:1.0:1787847333.482716:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349824 00000100:00100000:1.0:1787847333.482749:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787847333.482756:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847333.482806:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616349824:12345-0@lo:400:kworker.0 Request processed in 51us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847333.482812:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787847333.482832:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349696 00000100:00100000:1.0:1787847333.482835:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349696 00000100:00100000:1.0:1787847333.482866:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787847333.482873:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616349696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847333.482903:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616349696:12345-0@lo:400:kworker.0 Request processed in 31us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847333.482908:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787847333.486090:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847333.486102:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847333.486739:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616349824:0@lo:400:kworker.0 00010000:00080000:2.0:1787847333.486762:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880036a1c0 x1874693616349696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847333.486773:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616349696:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.486869:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616349952:0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.486949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847333.486998:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616349952 00000100:00100000:2.0:1787847333.487003:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616349952 00000100:00100000:2.0:1787847333.487059:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787847333.487069:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616349952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847333.487118:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616349952:12345-0@lo:400:kworker.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847333.487125:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1787847333.487159:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880036a1c0 x1874693616349952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847333.487169:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616349952:0@lo:400:kworker.0 00000100:00080000:0.0:1787847333.488725:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1787847333.536321:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4cd94325-5cad-4012-9431-9a61496a2886 00000100:00100000:2.0:1787847333.975172:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847333.975231:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616350080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847333.975303:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847333.975431:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350080 00000100:00100000:3.0:1787847333.975439:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350080 00000100:00100000:3.0:1787847333.975665:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787847333.975676:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616350080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847333.975775:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847333.975826:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616350080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847333.975833:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787847333.975872:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b1a40 x1874693616350080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847333.975891:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616350080:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787847334.034189:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4cd94325-5cad-4012-9431-9a61496a2886 00010000:00010000:1.0:1787847334.359835:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847335.383318:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847336.407188:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847336.887233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847336.890037:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847336.890084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847336.890104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847336.890150:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847336.890212:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344768 00000100:00100000:0.0:1787847336.890224:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344768 00000100:00100000:0.0:1787847336.890295:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344640 00000100:00100000:0.0:1787847336.890299:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344640 00000100:00100000:0.0:1787847336.890337:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:0.0:1787847336.890361:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595344768:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847336.890716:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595344768:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 367us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847336.890726:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:0.0:1787847336.890749:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:0.0:1787847336.890756:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595344640:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847336.890783:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595344640:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847336.890801:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00080000:0.0:1787847336.890821:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847336.890987:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345024 00000100:00100000:1.0:1787847336.890993:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345024 00000100:00100000:1.0:1787847336.891036:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344896 00000100:00100000:1.0:1787847336.891039:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344896 00000100:00100000:1.0:1787847336.891062:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:1.0:1787847336.891070:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595345024:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847336.891100:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b06d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595345024:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 33us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847336.891120:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:1.0:1787847336.891134:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:1.0:1787847336.891139:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800179050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595344896:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847336.891161:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800179050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595344896:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 22us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847336.891178:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00080000:1.0:1787847336.891835:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787847336.891841:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847336.906051:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595344512 00000100:00100000:2.0:1787847336.906073:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595344512 00000100:00100000:2.0:1787847336.906250:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 221 00000100:00100000:2.0:1787847336.906263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595344512:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847336.906398:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595344512:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 137us (19180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847336.906408:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 221 00000100:00100000:2.0:1787847337.055071:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787847337.055102:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616350208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847337.055501:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847337.055640:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350208 00000100:00100000:0.0:1787847337.055652:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350208 00000100:00100000:0.0:1787847337.055735:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787847337.055749:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616350208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847337.055799:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847337.055857:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616350208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847337.055865:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1787847337.056030:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787847337.056072:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800368780 x1874693616350208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847337.056096:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616350208:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787847337.064516:0:10308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1787847337.431794:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847338.455982:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847338.583323:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616350464:0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.583443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847338.583504:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616350976:0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.583527:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847338.583556:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847338.583561:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616350592:0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.583581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847338.583616:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350464 00000100:00100000:2.0:1787847338.583622:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350464 00000100:00100000:2.0:1787847338.583664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350592 00000100:00100000:2.0:1787847338.583667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350592 00000100:00100000:2.0:1787847338.583707:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787847338.583716:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616350464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.583765:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616350464:12345-0@lo:400:kworker.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847338.583785:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787847338.583802:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787847338.583808:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616350592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.583838:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616350592:12345-0@lo:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847338.583844:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787847338.583862:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350976 00000100:00100000:2.0:1787847338.583866:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350976 00000100:00100000:2.0:1787847338.583895:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787847338.583902:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.583966:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616350976:12345-0@lo:400:kworker.0 Request processed in 64us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847338.583972:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1787847338.583995:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847338.584000:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847338.584030:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616350592:0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.584039:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616350464:0@lo:400:kworker.0 00010000:00080000:2.0:1787847338.584049:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ab840 x1874693616350976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847338.584059:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616350976:0@lo:400:kworker.0 00000100:00100000:0.0:1787847338.584182:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616350720:0@lo:400:kworker.0 00000100:00100000:0.0:1787847338.584213:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847338.584230:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787847338.584235:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616350336:0@lo:400:kworker.0 00000100:00100000:0.0:1787847338.584259:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847338.584280:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616350848:0@lo:400:kworker.0 00000100:00100000:0.0:1787847338.584299:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847338.584509:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350720 00000100:00100000:2.0:1787847338.584514:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350720 00000100:00100000:2.0:1787847338.584546:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787847338.584552:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616350720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.584597:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616350720:12345-0@lo:400:kworker.0 Request processed in 45us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847338.584603:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787847338.584618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350336 00000100:00100000:2.0:1787847338.584621:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350336 00000100:00100000:2.0:1787847338.584639:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787847338.584645:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616350336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.584672:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616350336:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847338.584678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787847338.584716:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616350336:0@lo:400:kworker.0 00010000:00080000:2.0:1787847338.584726:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d880036b840 x1874693616350720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847354 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847338.584735:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616350720:0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.584754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616350848 00000100:00100000:2.0:1787847338.584757:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616350848 00000100:00100000:2.0:1787847338.584784:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787847338.584790:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616350848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847338.584821:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616350848:12345-0@lo:400:kworker.0 Request processed in 32us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847338.584827:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787847338.584842:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847338.584860:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616350848:0@lo:400:kworker.0 00000100:00100000:3.0:1787847339.097434:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847339.097467:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616351104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847339.097543:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847339.097652:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351104 00000100:00100000:1.0:1787847339.097662:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351104 00000100:00100000:1.0:1787847339.097718:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787847339.097729:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616351104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847339.097766:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847339.097815:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616351104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847339.097822:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787847339.097894:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c761c0 x1874693616351104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847339.097915:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616351104:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847339.479961:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847340.503444:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847341.527100:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847342.003561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847342.003675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847342.003714:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345280 00000100:00100000:1.0:1787847342.003724:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345280 00000100:00100000:1.0:1787847342.003795:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:1.0:1787847342.003813:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595345280:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847342.003891:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595345280:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847342.003899:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00080000:1.0:1787847342.003920:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847342.004097:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345152 00000100:00100000:0.0:1787847342.004103:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345152 00000100:00100000:0.0:1787847342.004132:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:0.0:1787847342.004140:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595345152:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847342.004184:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595345152:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 46us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847342.004190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:1.0:1787847342.022584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847342.022633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847342.022652:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847342.022676:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345536 00000100:00100000:1.0:1787847342.022685:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345536 00000100:00100000:1.0:1787847342.022739:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345664 00000100:00100000:1.0:1787847342.022742:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345664 00000100:00100000:1.0:1787847342.022763:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1787847342.022771:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595345536:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847342.022833:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595345536:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 63us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847342.022841:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1787847342.022857:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:1.0:1787847342.022863:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595345664:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847342.022886:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595345664:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 23us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847342.022892:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:1.0:1787847342.022912:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345408 00000100:00100000:1.0:1787847342.022915:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345408 00000100:00100000:1.0:1787847342.022966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:1.0:1787847342.022972:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595345408:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847342.023007:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595345408:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 35us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847342.023014:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00080000:1.0:1787847342.023050:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787847342.023055:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787847342.023060:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847342.167996:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616351232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847342.168120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847342.175748:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351232 00000100:00100000:1.0:1787847342.175760:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351232 00000100:00100000:1.0:1787847342.175840:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787847342.175848:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616351232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847342.175882:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847342.175960:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616351232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (7852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847342.175965:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787847342.176197:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787847342.176235:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c761c0 x1874693616351232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847342.176262:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616351232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787847342.553888:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847343.576787:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847343.705159:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616351360:0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.705255:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d2170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616351616:0@lo:400:kworker.0 00000100:00100000:3.0:1787847343.705276:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847343.705386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351360 00000100:00100000:1.0:1787847343.705397:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351360 00000100:00100000:1.0:1787847343.705470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787847343.705482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847343.707026:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616351872:0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.708540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847343.708597:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787847343.708608:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616351488:0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.708649:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847343.708669:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616352000:0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.708694:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847343.709457:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847343.709495:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787847343.709502:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351616 00000100:00100000:3.0:1787847343.709506:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616351744:0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.709512:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351616 00000100:00100000:3.0:1787847343.709538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847343.709596:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351488 00000100:00100000:2.0:1787847343.709601:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351488 00000100:00100000:1.0:1787847343.709604:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351872 00000100:00100000:1.0:1787847343.709620:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351872 00000100:00100000:2.0:1787847343.709631:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787847343.709647:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616351616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847343.709686:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787847343.709701:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616351488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.709729:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616351616:12345-0@lo:400:kworker.0 Request processed in 86us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847343.709738:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787847343.709765:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787847343.709792:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d2170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616351616:0@lo:400:kworker.0 00000100:00100000:1.0:1787847343.709799:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616351488:12345-0@lo:400:kworker.0 Request processed in 99us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847343.709828:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c761c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616351488:0@lo:400:kworker.0 00000100:00100000:3.0:1787847343.710086:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352000 00000100:00100000:3.0:1787847343.710257:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352000 00000100:00100000:3.0:1787847343.710300:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616351744 00000100:00100000:3.0:1787847343.710303:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616351744 00000100:00100000:3.0:1787847343.710322:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787847343.710329:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616352000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.710504:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616351872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847343.713481:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787847343.713583:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787847343.713613:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616351744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847343.713813:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ab840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616352000:12345-0@lo:400:kworker.0 Request processed in 3476us (5110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847343.713829:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787847343.714027:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d3c1a1c0 x1874693616352000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847343.714042:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616352000:0@lo:400:kworker.0 00000100:00100000:0.0:1787847343.714348:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616351360:12345-0@lo:400:kworker.0 Request processed in 8866us (9076us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847343.714376:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:3.0:1787847343.716538:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847343.716548:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847343.717077:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616351872:12345-0@lo:400:kworker.0 Request processed in 6569us (7619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847343.717091:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787847343.717176:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616351872:0@lo:400:kworker.0 00000100:00100000:2.0:1787847343.717190:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616351360:0@lo:400:kworker.0 00000100:00100000:1.0:1787847343.717603:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616351744:12345-0@lo:400:kworker.0 Request processed in 4000us (8055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847343.717621:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787847343.717966:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d3c18b40 x1874693616351744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847343.717981:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616351744:0@lo:400:kworker.0 00000100:00100000:1.0:1787847344.221365:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616352128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847344.221441:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847344.221530:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352128 00000100:00100000:1.0:1787847344.221539:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352128 00000100:00100000:1.0:1787847344.221588:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787847344.221597:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616352128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847344.221633:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847344.221678:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616352128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847344.221685:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787847344.221725:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d3c1a940 x1874693616352128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847344.221742:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616352128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787847344.600410:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847345.628149:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847346.647877:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847347.120801:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847347.120890:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847347.120948:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847347.120976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847347.121005:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847347.121038:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346304 00000100:00100000:2.0:1787847347.121051:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346304 00000100:00100000:2.0:1787847347.121124:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346176 00000100:00100000:2.0:1787847347.121128:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346176 00000100:00100000:2.0:1787847347.121154:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:2.0:1787847347.121167:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346304:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847347.121264:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346304:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 100us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847347.121273:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:2.0:1787847347.121293:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:2.0:1787847347.121301:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346176:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847347.121337:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346176:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 38us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847347.121344:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:2.0:1787847347.121365:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346048 00000100:00100000:2.0:1787847347.121369:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346048 00000100:00100000:2.0:1787847347.121397:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345920 00000100:00100000:2.0:1787847347.121400:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345920 00000100:00100000:2.0:1787847347.121420:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:2.0:1787847347.121426:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88003692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346048:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847347.121476:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88003692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346048:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 50us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847347.121483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:2.0:1787847347.121495:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:2.0:1787847347.121501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595345920:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847347.121525:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595345920:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847347.121532:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00080000:2.0:1787847347.121610:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787847347.121616:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847347.121618:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847347.134317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595345792 00000100:00100000:0.0:1787847347.134341:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595345792 00000100:00100000:0.0:1787847347.134606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:0.0:1787847347.134620:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595345792:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847347.134759:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595345792:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 142us (13974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847347.134770:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:3.0:1787847347.287285:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616352256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847347.287391:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847347.287501:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352256 00000100:00100000:0.0:1787847347.287511:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352256 00000100:00100000:0.0:1787847347.287591:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787847347.287603:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616352256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847347.287650:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847347.290219:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616352256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2607us (2816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847347.290238:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787847347.290281:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787847347.291264:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d3c1a940 x1874693616352256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847347.291315:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c1a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616352256:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787847347.673979:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847348.695311:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847348.823834:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616352768:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.823955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847348.824025:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847348.824032:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616352384:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824061:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847348.824101:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616352896:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847348.824172:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616352512:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847348.824252:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616353024:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824284:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847348.824304:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847348.824309:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616352640:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824329:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847348.824366:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352768 00000100:00100000:3.0:1787847348.824373:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352768 00000100:00100000:3.0:1787847348.824427:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353024 00000100:00100000:3.0:1787847348.824431:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353024 00000100:00100000:3.0:1787847348.824465:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787847348.824474:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616352768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824529:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c761c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616352768:12345-0@lo:400:kworker.0 Request processed in 56us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847348.824537:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787847348.824553:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787847348.824558:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616353024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824583:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616353024:12345-0@lo:400:kworker.0 Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847348.824589:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787847348.824606:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352896 00000100:00100000:3.0:1787847348.824609:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352896 00000100:00100000:3.0:1787847348.824636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352512 00000100:00100000:3.0:1787847348.824639:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352512 00000100:00100000:3.0:1787847348.824650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352640 00000100:00100000:3.0:1787847348.824652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352640 00000100:00100000:3.0:1787847348.824667:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787847348.824673:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616352896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824702:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616352896:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847348.824715:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787847348.824725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787847348.824730:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616352512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824753:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616352512:12345-0@lo:400:kworker.0 Request processed in 23us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847348.824758:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787847348.824767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787847348.824772:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616352640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824792:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616352640:12345-0@lo:400:kworker.0 Request processed in 20us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847348.824798:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787847348.824861:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616352640:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824871:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616352512:0@lo:400:kworker.0 00010000:00080000:3.0:1787847348.824883:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9c75a40 x1874693616353024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847348.824894:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616353024:0@lo:400:kworker.0 00000100:00100000:3.0:1787847348.824924:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616352896:0@lo:400:kworker.0 00010000:00080000:3.0:1787847348.824959:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c28b12c0 x1874693616352768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847348.824969:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616352768:0@lo:400:kworker.0 00000100:00100000:1.0:1787847348.828311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616352384 00000100:00100000:1.0:1787847348.828333:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616352384 00000100:00100000:1.0:1787847348.828410:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787847348.828423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616352384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847348.828606:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616352384:12345-0@lo:400:kworker.0 Request processed in 186us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847348.828615:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1787847348.828772:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787847348.828781:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847348.830894:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616352384:0@lo:400:kworker.0 00000100:00100000:1.0:1787847349.336231:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616353152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847349.336358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847349.337054:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353152 00000100:00100000:0.0:1787847349.337074:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353152 00000100:00100000:0.0:1787847349.337167:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787847349.337179:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616353152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847349.337245:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847349.337331:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616353152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847349.337360:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787847349.337376:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800369e00 x1874693616353152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847349.337408:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616353152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847349.719410:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847350.746804:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847351.771314:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847352.239791:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847352.239879:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346432 00000100:00100000:1.0:1787847352.239892:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346432 00000100:00100000:1.0:1787847352.239979:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:1.0:1787847352.239990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595346432:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847352.240080:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595346432:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847352.240088:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:1.0:1787847352.243323:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847352.243417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346560 00000100:00100000:3.0:1787847352.243427:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346560 00000100:00100000:3.0:1787847352.243510:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:3.0:1787847352.243521:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595346560:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847352.243614:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595346560:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 95us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847352.243620:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00080000:1.0:1787847352.243962:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847352.244908:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847352.245053:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346688 00000100:00100000:3.0:1787847352.245061:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346688 00000100:00100000:3.0:1787847352.245134:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:3.0:1787847352.245145:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346688:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847352.245211:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595346688:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847352.245232:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00080000:1.0:1787847352.245366:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847352.246006:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847352.246039:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847352.246110:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346816 00000100:00100000:1.0:1787847352.246116:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346816 00000100:00100000:1.0:1787847352.246164:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595346944 00000100:00100000:1.0:1787847352.246168:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595346944 00000100:00100000:1.0:1787847352.246187:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:1.0:1787847352.246195:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2343:x1874693595346816:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:1.0:1787847352.246228:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861c2f 00000100:00080000:1.0:1787847352.246238:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d88007a5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787847352.246278:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787847352.246855:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4cd94325-5cad-4012-9431-9a61496a2886+2:2343:x1874693595346816:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 658us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847352.246864:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:1.0:1787847352.246882:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1787847352.246891:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2343:x1874693595346944:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:1.0:1787847352.246905:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861c36 00000100:00080000:1.0:1787847352.246911:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d8800569000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787847352.246970:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787847352.247156:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4cd94325-5cad-4012-9431-9a61496a2886+2:2343:x1874693595346944:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 266us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847352.247164:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00010000:00010000:1.0:1787847352.247196:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847352.247203:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787847352.250574:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847352.250584:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847352.408853:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616353280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847352.409105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847352.409753:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353280 00000100:00100000:3.0:1787847352.409762:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353280 00000100:00100000:3.0:1787847352.409871:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787847352.409881:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616353280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847352.409927:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847352.410001:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616353280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847352.410008:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787847352.410045:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87d3c18000 x1874693616353280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847352.410063:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616353280:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787847352.417534:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787847352.792653:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787847353.542290:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4cd94325-5cad-4012-9431-9a61496a2886 00000020:00000080:3.0:1787847353.542304:0:7632:0:(genops.c:885:class_export_put()) final put ffff8d880056c800/4cd94325-5cad-4012-9431-9a61496a2886 00000020:00000080:1.0:1787847353.542411:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880056c800/4cd94325-5cad-4012-9431-9a61496a2886 for lustre-OST0001 00000020:00000080:1.0:1787847353.542472:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d8800569000 for lustre-OST0001 00010000:00010000:2.0:1787847353.815280:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847353.944364:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616353792:0@lo:400:kworker.0 00000100:00100000:3.0:1787847353.944449:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847353.944520:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847353.944527:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616353408:0@lo:400:kworker.0 00000100:00100000:3.0:1787847353.944556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847353.944847:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353792 00000100:00100000:1.0:1787847353.944855:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353792 00000100:00100000:1.0:1787847353.944903:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787847353.944914:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616353792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.944984:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616353792:12345-0@lo:400:kworker.0 Request processed in 72us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847353.944992:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787847353.950036:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616353664:0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.950223:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847353.950294:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787847353.950302:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616353536:0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.950328:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847353.951305:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616354048:0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.951343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847353.951394:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353664 00000100:00100000:1.0:1787847353.951403:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353664 00000100:00100000:1.0:1787847353.951459:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353536 00000100:00100000:1.0:1787847353.951463:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353536 00000100:00100000:1.0:1787847353.951499:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787847353.951508:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616353664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.951567:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616353664:12345-0@lo:400:kworker.0 Request processed in 59us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847353.951591:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787847353.951607:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787847353.951613:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616353536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.951642:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bda580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616353536:12345-0@lo:400:kworker.0 Request processed in 30us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847353.951647:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787847353.951664:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616354048 00000100:00100000:1.0:1787847353.951667:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616354048 00000100:00100000:1.0:1787847353.951692:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787847353.951698:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616354048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.951725:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616354048:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847353.951730:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787847353.951746:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787847353.951749:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847353.951778:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616353536:0@lo:400:kworker.0 00010000:00080000:1.0:1787847353.951791:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ad680 x1874693616354048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847353.951800:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616354048:0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.951809:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616353664:0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.959611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353408 00000100:00100000:1.0:1787847353.959625:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353408 00000100:00100000:1.0:1787847353.959813:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787847353.959828:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616353408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.959951:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616353408:12345-0@lo:400:kworker.0 Request processed in 126us (15392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847353.959961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787847353.960179:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616353408:0@lo:400:kworker.0 00000100:00100000:2.0:1787847353.960203:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616353920:0@lo:400:kworker.0 00000100:00100000:2.0:1787847353.960244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787847353.960286:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88007ac3c0 x1874693616353792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847353.960299:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616353792:0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.961606:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616353920 00000100:00100000:1.0:1787847353.961619:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616353920 00000100:00080000:3.0:1787847353.961689:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847353.961698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787847353.961710:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616353920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847353.961790:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616353920:12345-0@lo:400:kworker.0 Request processed in 82us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847353.961799:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787847353.961865:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007acf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616353920:0@lo:400:kworker.0 00000100:00100000:1.0:1787847354.455304:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616354176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847354.455394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847354.455513:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616354176 00000100:00100000:3.0:1787847354.455522:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616354176 00000100:00100000:3.0:1787847354.455603:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787847354.455614:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616354176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847354.455659:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847354.455721:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616354176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847354.455728:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787847354.455785:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87de82da40 x1874693616354176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847354.455806:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616354176:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787847354.506650:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4cd94325-5cad-4012-9431-9a61496a2886 00000020:00000080:3.0:1787847354.506658:0:6706:0:(genops.c:885:class_export_put()) final put ffff8d88007a3800/4cd94325-5cad-4012-9431-9a61496a2886 00000020:00000080:2.0:1787847354.506717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d88007a3800/4cd94325-5cad-4012-9431-9a61496a2886 for lustre-OST0000 00000020:00000080:2.0:1787847354.506871:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d88007a5800 for lustre-OST0000 00010000:00010000:1.0:1787847354.839523:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787847355.634190:0:11011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787847355.863243:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847356.887462:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847357.363836:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847357.363875:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847357.363971:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847357.364006:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347200 00000100:00100000:1.0:1787847357.364016:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347200 00000100:00100000:1.0:1787847357.364075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347328 00000100:00100000:1.0:1787847357.364079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347328 00000100:00100000:1.0:1787847357.364100:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1787847357.364109:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595347200:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847357.364341:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:2.0:1787847357.364353:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595347328:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847357.366075:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595347200:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 1954us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847357.366090:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:3.0:1787847357.368099:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347072 00000100:00100000:3.0:1787847357.368113:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347072 00000100:00100000:3.0:1787847357.368648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:3.0:1787847357.368664:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595347072:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847357.370313:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595347328:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 5950us (6328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847357.370328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00080000:2.0:1787847357.371689:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847357.375810:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595347072:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 7139us (11922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847357.375825:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:1.0:1787847357.528463:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847357.528485:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616354304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847357.528553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847357.528615:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616354304 00000100:00100000:1.0:1787847357.528621:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616354304 00000100:00100000:1.0:1787847357.528689:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787847357.528698:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616354304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847357.528729:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847357.528766:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616354304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847357.528773:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1787847357.528792:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787847357.528820:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bdb840 x1874693616354304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847357.528839:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616354304:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787847357.914719:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847358.937555:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787847358.943179:0:11158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7ece1780 20000000:00000080:3.0:1787847358.943199:0:11158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d880035e800 uarg=0000000000000000 20000000:01000000:3.0:1787847358.943237:0:11158:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787847358.943243:0:11158:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787847358.943248:0:11158:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787847358.944484:0:11159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787847358.944876:0:11158:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787847358.953584:0:11158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787847358.953621:0:11158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953642:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861b9c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953651:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953658:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953669:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953676:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953698:0:11158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953744:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953760:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 12 pid: 5835 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.953775:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354432:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847358.953893:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.953902:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.953910:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ae940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354560:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847358.961318:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.961339:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 18 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.961367:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354688:0@lo:104: 00000100:00100000:3.0:1787847358.961440:0:11158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787847358.962331:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.962375:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 18 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.962388:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007acf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354816:0@lo:104: 00000100:00100000:3.0:1787847358.962423:0:11158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847358.962452:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616354688 00000100:00100000:3.0:1787847358.962459:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616354688 00000100:00100000:3.0:1787847358.962498:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616354816 00000100:00100000:3.0:1787847358.962500:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616354816 00000100:00100000:3.0:1787847358.962530:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847358.962540:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:11158:x1874693616354688:12345-0@lo:104: 00010000:00010000:3.0:1787847358.962552:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.962599:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787847358.962605:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:11158:x1874693616354688:12345-0@lo:104: Request processed in 67us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847358.962612:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847358.962629:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787847358.962635:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:11158:x1874693616354816:12345-0@lo:104: 00010000:00010000:3.0:1787847358.962642:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.962673:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787847358.962679:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:11158:x1874693616354816:12345-0@lo:104: Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847358.962685:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787847358.962720:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861b9c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.962729:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861b9c expref: 18 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.962737:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007afc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354944:0@lo:104: 00000100:00100000:3.0:1787847358.962759:0:11158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847358.962777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616354944 00000100:00100000:3.0:1787847358.962781:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616354944 00000100:00100000:3.0:1787847358.962797:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787847358.962801:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:11158:x1874693616354944:12345-0@lo:104: 00010000:00010000:3.0:1787847358.962809:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.962840:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787847358.962845:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:11158:x1874693616354944:12345-0@lo:104: Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847358.962851:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787847358.962880:0:11158:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbcc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787847358.962902:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354432:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847358.962911:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354688:0@lo:104: 00000100:00100000:3.0:1787847358.962917:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007acf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354816:0@lo:104: 00000100:00100000:3.0:1787847358.962922:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007afc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354944:0@lo:104: 00010000:00010000:3.0:1787847358.962979:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787847358.963176:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963197:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847358.963201:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963209:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847358.963217:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847358.963222:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787847358.963253:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963260:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847358.963278:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963284:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe800/0x1835de88b9861bf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861bf7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963296:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847358.963300:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963305:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0030600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847358.963308:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963325:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847358.963331:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847358.963336:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787847358.963350:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963355:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847358.963372:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963379:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c0030600/0x1835de88b9861bc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861bcd expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963390:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847358.963393:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963399:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847358.963401:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963406:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847358.963799:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847358.963811:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787847358.963828:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963833:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847358.963840:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963846:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152b000/0x1835de88b9861b9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861ba3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.963871:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847358.963873:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847358.963875:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847358.963895:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847358.963909:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616355072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847358.963976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787847358.964627:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847358.966588:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616355200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847358.966644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847358.966675:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847358.966681:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616355328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847358.966699:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847358.967228:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355072 00000100:00100000:3.0:1787847358.967237:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355072 00010000:00010000:3.0:1787847358.967275:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 19 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.967310:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355200 00000100:00100000:3.0:1787847358.967322:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355200 00010000:00010000:3.0:1787847358.967335:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 20 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.967347:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355328 00000100:00100000:3.0:1787847358.967349:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355328 00010000:00010000:3.0:1787847358.967358:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861b9c expref: 21 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.967371:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787847358.967379:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+21:3300:x1874693616355072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847358.967391:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847358.967396:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 21 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967406:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 21 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967425:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6000/0x1835de88b9861bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861bf0 expref: 21 pid: 5837 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967439:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847358.967482:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+20:3300:x1874693616355072:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (3505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847358.967489:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787847358.967545:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787847358.967551:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616355200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847358.967557:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847358.967561:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 19 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967578:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 19 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967587:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861bcd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861bc6 expref: 19 pid: 5838 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967596:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847358.967620:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3302:x1874693616355200:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847358.967625:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787847358.967638:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787847358.967643:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:3302:x1874693616355328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847358.967651:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847358.967655:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861b9c expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967662:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861b9c expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967672:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6400/0x1835de88b9861ba3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861b9c expref: 17 pid: 5835 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847358.967680:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847358.967699:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3302:x1874693616355328:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847358.967705:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787847358.967722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847358.967753:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ad680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616355072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847358.967792:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616355328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847358.967799:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007acb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616355200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787847358.971216:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847358.971318:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847358.971390:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ae940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874693616354560:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847358.971429:0:11158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847358.975779:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347456 00000100:00100000:3.0:1787847358.975793:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347456 00010000:00010000:3.0:1787847358.975843:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 13 pid: 5835 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847358.976195:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347584 00000100:00100000:0.0:1787847358.976200:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347584 00000100:00100000:2.0:1787847358.976404:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:2.0:1787847358.976415:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+14:2347:x1874693595347456:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847358.976431:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847358.976437:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 14 pid: 5835 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847358.976450:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 14 pid: 5835 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847358.976467:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861c21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b97 expref: 14 pid: 5835 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847358.976479:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847358.976548:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595347456:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 135us (5342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847358.976567:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00010000:00010000:1.0:1787847358.977203:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847358.977245:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:1.0:1787847358.977255:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:2347:x1874693595347584:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847358.977267:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847358.977280:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977293:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977308:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b5f expref: 12 pid: 5837 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977322:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977331:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977346:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977353:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977360:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977367:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977373:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6e00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847358.977378:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977386:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977408:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977418:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847358.977447:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:2347:x1874693595347584:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 195us (6129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847358.977455:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00010000:00010000:1.0:1787847358.977486:0:11158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977505:0:11158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847358.977511:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861c3d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847359.066124:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616355584:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066198:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847359.066245:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787847359.066251:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616355456:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066274:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847359.066291:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616355968:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847359.066348:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616355712:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066372:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847359.066390:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847359.066395:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616355840:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847359.066452:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355584 00000100:00100000:2.0:1787847359.066459:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355584 00000100:00100000:2.0:1787847359.066523:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355456 00000100:00100000:2.0:1787847359.066527:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355456 00000100:00100000:2.0:1787847359.066541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355840 00000100:00100000:2.0:1787847359.066543:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355840 00000100:00100000:2.0:1787847359.066559:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787847359.066568:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616355584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066620:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616355584:12345-0@lo:400:kworker.0 Request processed in 53us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847359.066628:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787847359.066648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787847359.066654:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616355456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066697:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616355456:12345-0@lo:400:kworker.0 Request processed in 44us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847359.066705:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787847359.066716:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787847359.066723:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616355840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066751:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616355840:12345-0@lo:400:kworker.0 Request processed in 29us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847359.066757:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787847359.066780:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355968 00000100:00100000:2.0:1787847359.066783:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355968 00000100:00100000:2.0:1787847359.066809:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616355712 00000100:00100000:2.0:1787847359.066812:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616355712 00000100:00100000:2.0:1787847359.066833:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787847359.066839:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616355968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066868:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616355968:12345-0@lo:400:kworker.0 Request processed in 29us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847359.066873:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787847359.066884:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787847359.066890:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616355712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.066915:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616355712:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847359.066920:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1787847359.066968:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847359.066973:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847359.066976:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847359.067014:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616355840:0@lo:400:kworker.0 00010000:00080000:2.0:1787847359.067038:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87de82e940 x1874693616355712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847359.067049:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616355712:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.067079:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616355456:0@lo:400:kworker.0 00010000:00080000:2.0:1787847359.067088:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87de82f840 x1874693616355968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847359.067109:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616355968:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.067119:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616355584:0@lo:400:kworker.0 00000100:00100000:2.0:1787847359.576972:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616356096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847359.577054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847359.577150:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356096 00000100:00100000:2.0:1787847359.577158:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356096 00000100:00100000:2.0:1787847359.577202:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787847359.577210:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616356096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847359.577242:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847359.577287:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616356096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847359.577294:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787847359.577337:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87de82d2c0 x1874693616356096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847359.577363:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616356096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847359.960368:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847360.308772:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847360.308867:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347712 00000100:00100000:1.0:1787847360.308877:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347712 00000100:00100000:1.0:1787847360.308974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:1.0:1787847360.308986:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:5587:x1874693595347712:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.309004:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847360.309037:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bc1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.309065:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.309088:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.309113:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165dc00, rc 0) 00000100:00100000:1.0:1787847360.309176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595347712:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 192us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.309183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:0.0:1787847360.311781:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847360.312085:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347840 00000100:00100000:3.0:1787847360.312096:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347840 00000100:00100000:3.0:1787847360.312141:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:3.0:1787847360.312151:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595347840:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847360.312655:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595347840:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 502us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847360.312664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:2.0:1787847360.328056:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847360.328348:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595347968 00000100:00100000:1.0:1787847360.328358:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595347968 00000100:00100000:1.0:1787847360.328419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 232 00000100:00100000:1.0:1787847360.328429:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595347968:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.328675:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595347968:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 246us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.328683:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 232 00000100:00100000:0.0:1787847360.350602:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847360.364756:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348096 00000100:00100000:1.0:1787847360.364769:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348096 00000100:00100000:1.0:1787847360.364828:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 233 00000100:00100000:1.0:1787847360.364837:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595348096:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.364853:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847360.364874:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bc8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.364902:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.364911:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.364920:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d200, rc 0) 00000100:00100000:1.0:1787847360.365013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595348096:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 176us (14422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.365019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 233 00000100:00100000:2.0:1787847360.381856:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847360.381976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348224 00000100:00100000:1.0:1787847360.381987:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348224 00000100:00100000:1.0:1787847360.382044:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 234 00000100:00100000:1.0:1787847360.382054:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595348224:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.382390:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595348224:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 336us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.382399:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 234 00000100:00100000:2.0:1787847360.386041:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847360.386405:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348352 00000100:00100000:3.0:1787847360.386415:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348352 00000100:00100000:3.0:1787847360.386488:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 235 00000100:00100000:3.0:1787847360.386500:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595348352:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847360.386745:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595348352:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 246us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847360.386752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 235 10000000:01000000:0.0:1787847360.410142:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787847360.410150:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ff957000 from 7 10000000:01000000:0.0:1787847360.410155:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787847360.410212:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847360.410224:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847360.410235:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847360.410262:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787847360.410343:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847360.410403:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.410654:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356224 00000100:00100000:1.0:1787847360.410662:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356224 00000100:00100000:1.0:1787847360.410718:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787847360.410727:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616356224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.410741:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847360.410756:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861c52 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.410779:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861c52 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.410790:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861c52 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.410800:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:1.0:1787847360.410841:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616356224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.410847:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787847360.411157:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847360.411174:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847360.411264:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847360.411327:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847360.411359:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847360.412326:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.416715:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356352 00000100:00100000:1.0:1787847360.416734:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356352 00000100:00100000:1.0:1787847360.416809:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787847360.416820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616356352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.417272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616356352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 453us (5910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.417280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787847360.417442:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847360.417518:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847360.417568:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847360.417594:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.417764:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356480 00000100:00100000:1.0:1787847360.417768:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356480 00000100:00100000:1.0:1787847360.417804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787847360.417812:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616356480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.417979:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616356480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.417986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787847360.418021:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787847360.418998:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787847360.419055:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787847360.419087:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787847360.419098:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.419109:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847360.419119:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787847360.419122:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ef8a4000 from 7 10000000:01000000:1.0:1787847360.419125:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787847360.419155:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.419169:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.419179:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847360.419356:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.419402:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847360.419554:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787847360.423122:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356608 00000100:00100000:0.0:1787847360.423138:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356608 00000100:00100000:1.0:1787847360.424432:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787847360.424454:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616356608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.424472:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847360.424499:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861c60 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.424530:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861c60 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.424542:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861c60 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.424551:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165cc00, rc 0) 00000100:00100000:1.0:1787847360.424636:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616356608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (5233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.424643:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787847360.424697:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.424717:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.424734:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847360.424806:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.424843:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847360.424869:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.424887:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356736 00000100:00100000:1.0:1787847360.424892:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356736 00000100:00100000:1.0:1787847360.424908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787847360.424914:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616356736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.425176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616356736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.425195:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787847360.425219:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.425246:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.425281:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847360.425290:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6300 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.425305:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356864 00000100:00100000:1.0:1787847360.425309:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356864 00000100:00100000:1.0:1787847360.425322:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787847360.425328:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616356864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.425457:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616356864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.425464:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787847360.425499:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787847360.426192:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787847360.426230:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787847360.426242:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787847360.426252:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426262:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847360.426272:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787847360.426274:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87d0568000 from 7 10000000:01000000:1.0:1787847360.426277:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787847360.426300:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426306:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426315:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847360.426331:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.426363:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847360.426379:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.426393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616356992 00000100:00100000:1.0:1787847360.426398:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616356992 00000100:00100000:1.0:1787847360.426419:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787847360.426424:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616356992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.426443:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847360.426454:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861c6e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426473:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861c6e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426483:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861c6e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426490:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c400, rc 0) 00000100:00100000:1.0:1787847360.426521:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616356992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.426527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787847360.426558:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616356992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847360.426570:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847360.426578:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847360.426616:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616357120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.426639:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847360.426651:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787847360.426661:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357120 00000100:00100000:1.0:1787847360.426664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357120 00000100:00100000:1.0:1787847360.426679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787847360.426684:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616357120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847360.426900:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616357120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847360.426907:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787847360.426985:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd8f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616357120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847360.427014:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616357248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847360.427050:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847360.427080:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7202b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787847360.427404:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357248 00000100:00100000:0.0:1787847360.427409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357248 00000100:00100000:0.0:1787847360.427434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787847360.427442:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616357248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847360.427622:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616357248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847360.427630:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787847360.427701:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616357248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787847360.429327:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787847360.429422:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787847360.429446:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787847360.429456:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847360.429682:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847360.983268:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847362.014305:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847362.479469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847362.479558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847362.479585:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847362.479722:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348480 00000100:00100000:0.0:1787847362.479734:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348480 00000100:00100000:0.0:1787847362.479787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 245 00000100:00100000:0.0:1787847362.479797:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595348480:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847362.479870:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595348480:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 74us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847362.479885:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 245 00000100:00100000:3.0:1787847362.480056:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348736 00000100:00100000:3.0:1787847362.480061:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348736 00000100:00100000:3.0:1787847362.480100:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348608 00000100:00100000:3.0:1787847362.480103:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348608 00000100:00100000:3.0:1787847362.480126:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:3.0:1787847362.480134:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595348736:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847362.480167:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007afc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595348736:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 34us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847362.480174:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:3.0:1787847362.480186:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:3.0:1787847362.480192:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595348608:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847362.480216:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595348608:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 25us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847362.480222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00080000:3.0:1787847362.480241:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847362.650171:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616357376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847362.650247:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847362.650334:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357376 00000100:00100000:2.0:1787847362.650341:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357376 00000100:00100000:2.0:1787847362.650395:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787847362.650404:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616357376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847362.652563:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847362.652680:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616357376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2273us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847362.652692:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787847362.652733:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787847362.652774:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87de82c000 x1874693616357376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847362.652812:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616357376:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787847362.874578:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787847363.031747:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847364.059121:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847364.183830:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1361680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616357888:0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.183904:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847364.183989:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787847364.183995:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616357504:0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.184037:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847364.184060:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616358016:0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.184084:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847364.184113:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357504 00000100:00100000:3.0:1787847364.184130:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357504 00000100:00100000:3.0:1787847364.184175:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787847364.184185:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616357504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.184234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616357504:12345-0@lo:400:kworker.0 Request processed in 50us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847364.184241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787847364.184273:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358016 00000100:00100000:3.0:1787847364.184276:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358016 00000100:00100000:3.0:1787847364.184310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787847364.184317:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616358016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.184347:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007acb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616358016:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847364.184353:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1787847364.184370:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847364.184397:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616357504:0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.184409:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1362d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616358016:0@lo:400:kworker.0 00000100:00100000:0.0:1787847364.184506:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357888 00000100:00100000:0.0:1787847364.184510:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357888 00000100:00100000:0.0:1787847364.184553:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787847364.184560:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616357888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847364.184596:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616357888:12345-0@lo:400:kworker.0 Request processed in 37us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847364.184602:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787847364.184728:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787847364.184749:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e1361680 x1874693616357888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847364.184759:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1361680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616357888:0@lo:400:kworker.0 00000100:00100000:2.0:1787847364.184889:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616357632:0@lo:400:kworker.0 00000100:00100000:2.0:1787847364.184951:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847364.184973:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1363840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616358144:0@lo:400:kworker.0 00000100:00100000:2.0:1787847364.184996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847364.185031:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847364.185038:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616357760:0@lo:400:kworker.0 00000100:00100000:2.0:1787847364.185060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847364.185087:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358144 00000100:00100000:2.0:1787847364.185091:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358144 00000100:00100000:2.0:1787847364.185121:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787847364.185128:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616358144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847364.185165:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616358144:12345-0@lo:400:kworker.0 Request processed in 38us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847364.185172:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1787847364.185205:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e1363840 x1874693616358144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847364.185216:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1363840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616358144:0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.185415:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357632 00000100:00100000:3.0:1787847364.185420:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357632 00000100:00100000:3.0:1787847364.185449:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616357760 00000100:00100000:3.0:1787847364.185451:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616357760 00000100:00100000:3.0:1787847364.185472:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787847364.185478:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616357632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.185532:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616357632:12345-0@lo:400:kworker.0 Request processed in 54us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847364.185538:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787847364.185550:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787847364.185557:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616357760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.185583:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616357760:12345-0@lo:400:kworker.0 Request processed in 27us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847364.185589:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1787847364.185608:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847364.185611:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847364.185627:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616357760:0@lo:400:kworker.0 00000100:00100000:3.0:1787847364.185637:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616357632:0@lo:400:kworker.0 00000100:00100000:0.0:1787847364.697151:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847364.697172:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616358272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847364.697238:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847364.697353:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358272 00000100:00100000:1.0:1787847364.697362:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358272 00000100:00100000:1.0:1787847364.697420:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787847364.697430:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616358272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847364.697467:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847364.697524:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616358272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847364.697532:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787847364.698112:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bd83c0 x1874693616358272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847364.698135:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616358272:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787847365.085593:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787847365.650372:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 12:16:04 (1787847364) === 00000100:00100000:2.0:1787847365.812923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847365.813011:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.813080:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348864 00000100:00100000:3.0:1787847365.813091:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348864 00000100:00100000:3.0:1787847365.813156:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1787847365.813167:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595348864:12345-192.168.201.21@tcp:41:mkdir.0 00000004:00000024:3.0:1787847365.813209:0:7214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787847365.813296:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595348864:12345-192.168.201.21@tcp:41:mkdir.0 Request processed in 130us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847365.813304:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1787847365.813510:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595348992 00000100:00100000:0.0:1787847365.813515:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595348992 00000100:00100000:0.0:1787847365.813548:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1787847365.813556:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:9659:x1874693595348992:12345-192.168.201.21@tcp:700:mkdir.0 00000100:00100000:0.0:1787847365.813604:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:9659:x1874693595348992:12345-192.168.201.21@tcp:700:mkdir.0 Request processed in 49us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847365.813610:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00080000:1.0:1787847365.813674:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847365.819284:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.819448:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595349248 00000100:00100000:3.0:1787847365.819459:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595349248 00000100:00100000:3.0:1787847365.819553:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1787847365.819564:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:9659:x1874693595349248:12345-192.168.201.21@tcp:36:mkdir.0 00010000:00010000:3.0:1787847365.819633:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847365.819714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861b5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b4a expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.819735:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7ff00) 00010000:00010000:3.0:1787847365.819746:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847365.820759:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.820778:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.820789:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.820827:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.820835:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.820842:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847365.823499:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787847365.823531:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.823547:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.823554:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.823560:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847365.823564:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.823572:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.823588:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:2.0:1787847365.823591:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847365.823595:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.823601:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861c7c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847365.823619:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef13f9f5 reply state 000000007afb5829 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847365.823627:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847365.823779:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9659:x1874693595349248:12345-192.168.201.21@tcp:36:mkdir.0 Request processed in 4213us (4503us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787847365.823788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00010000:00010000:1.0:1787847365.827007:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.827024:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.827033:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.827039:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847365.827044:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.827053:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.827093:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d87c3361000) 00010000:00010000:1.0:1787847365.827096:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847365.827101:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.827107:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861c83 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847365.833621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.833902:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595349376 00000100:00100000:3.0:1787847365.833912:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595349376 00000100:00100000:3.0:1787847365.834001:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:3.0:1787847365.834012:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:9660:x1874693595349376:12345-192.168.201.21@tcp:101:chmod.0 00010000:00010000:3.0:1787847365.834037:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847365.834062:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bcf expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.834153:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861c91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.834164:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861c91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.834172:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861c91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847365.834229:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787847365.834409:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847365.834457:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861c91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.834477:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bcf expref: 8 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.834490:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861c91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bcf expref: 7 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.834497:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361800) 00010000:00010000:3.0:1787847365.834499:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847365.834501:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7000, rc 0) 00000100:00100000:3.0:1787847365.834591:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9660:x1874693595349376:12345-192.168.201.21@tcp:101:chmod.0 Request processed in 581us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847365.834596:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:3.0:1787847365.837917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847365.838213:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595349632 00000100:00100000:2.0:1787847365.838335:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595349632 00000100:00100000:2.0:1787847365.838463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1787847365.838473:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9660:x1874693595349632:12345-192.168.201.21@tcp:36:chmod.0 00010000:00010000:2.0:1787847365.838526:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847365.838552:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861c91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bcf expref: 7 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.838569:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361800) 00010000:00010000:2.0:1787847365.838578:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847365.838600:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.838610:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.838616:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847365.839457:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c4bb38f reply state 00000000b67c79dd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847365.839467:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787847365.839480:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787847365.839576:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:9660:x1874693595349632:12345-192.168.201.21@tcp:36:chmod.0 Request processed in 1103us (1667us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787847365.839584:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00010000:00010000:0.0:1787847365.842316:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.842334:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.842357:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.842364:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847365.842368:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.842375:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.842403:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f100) 00010000:00010000:0.0:1787847365.842407:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787847365.842412:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.842418:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861c98 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847365.860795:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847365.860884:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595349760 00000100:00100000:2.0:1787847365.860895:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595349760 00000100:00100000:2.0:1787847365.861016:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1787847365.861026:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9661:x1874693595349760:12345-192.168.201.21@tcp:101:chown.0 00010000:00010000:2.0:1787847365.861057:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847365.861090:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bd6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.861369:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861ca6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.861388:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.861401:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847365.861464:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787847365.861468:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847365.861510:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.861538:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bd6 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.861558:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bd6 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.861567:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:2.0:1787847365.861570:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847365.861573:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a800, rc 0) 00000100:00100000:2.0:1787847365.861629:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:9661:x1874693595349760:12345-192.168.201.21@tcp:101:chown.0 Request processed in 604us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847365.861636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1787847365.865726:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.865795:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595349888 00000100:00100000:3.0:1787847365.865804:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595349888 00000100:00100000:3.0:1787847365.865850:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847365.865858:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:9661:x1874693595349888:12345-192.168.201.21@tcp:101:chown.0 00010000:00010000:3.0:1787847365.865880:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847365.865900:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bdd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866021:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866036:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866047:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866062:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866077:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866082:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866172:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861cc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866178:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866198:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847365.866229:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787847365.866231:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847365.866263:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861cc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866272:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866276:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866280:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866284:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847365.866286:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866291:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866299:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:3.0:1787847365.866301:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847365.866304:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866308:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cb4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866324:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866328:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866331:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866334:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847365.866336:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866339:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866343:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d87c3361f00) 00010000:00010000:3.0:1787847365.866344:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847365.866345:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866348:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866529:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bdd expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866543:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861cc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bdd expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.866560:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c3361600) 00010000:00010000:3.0:1787847365.866561:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847365.866563:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847365.866609:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:9661:x1874693595349888:12345-192.168.201.21@tcp:101:chown.0 Request processed in 753us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847365.866625:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1787847365.873038:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847365.873177:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595350144 00000100:00100000:2.0:1787847365.873187:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595350144 00000100:00100000:2.0:1787847365.873258:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:2.0:1787847365.873270:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:9661:x1874693595350144:12345-192.168.201.21@tcp:36:chown.0 00010000:00010000:2.0:1787847365.873321:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847365.873344:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bdd expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.873358:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c3361600) 00010000:00010000:2.0:1787847365.873366:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847365.873390:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.873403:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.873413:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847365.905231:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000114439cf reply state 00000000487dafa5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847365.905253:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787847365.905431:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787847365.905617:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:9661:x1874693595350144:12345-192.168.201.21@tcp:36:chown.0 Request processed in 32345us (32582us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787847365.905627:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000001:00080000:2.0:1787847365.905683:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1787847365.905807:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.905817:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.905824:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.905831:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847365.905835:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.905844:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.905860:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c4d7fb00) 00010000:00010000:1.0:1787847365.905863:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787847365.905868:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.905875:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861cc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847365.926539:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.926778:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595350272 00000100:00100000:3.0:1787847365.926788:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595350272 00000100:00100000:3.0:1787847365.926857:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:3.0:1787847365.926867:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:9662:x1874693595350272:12345-192.168.201.21@tcp:101:touch.500 00010000:00010000:3.0:1787847365.926900:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847365.926922:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861cd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0be4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787847365.929618:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2583us 00010000:00010000:0.0:1787847365.944217:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944241:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944254:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944270:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944290:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944298:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944766:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944776:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.944783:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847365.944862:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787847365.944866:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847365.945035:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945050:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945056:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945063:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945069:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847365.945073:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945086:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945099:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:0.0:1787847365.945103:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847365.945108:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945114:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945126:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945132:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945139:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945144:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847365.945146:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945152:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945159:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d87c7207400) 00010000:00010000:0.0:1787847365.945161:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847365.945164:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945179:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861cde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945218:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861cd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0be4 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945232:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0be4 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.945239:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:0.0:1787847365.945242:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787847365.945244:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afea00, rc 0) 00000100:00100000:0.0:1787847365.945315:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9662:x1874693595350272:12345-192.168.201.21@tcp:101:touch.500 Request processed in 18449us (18786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847365.945325:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:0.0:1787847365.954228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.954342:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595350528 00000100:00100000:3.0:1787847365.954352:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595350528 00000100:00100000:3.0:1787847365.954428:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:3.0:1787847365.954440:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9662:x1874693595350528:12345-192.168.201.21@tcp:101:touch.500 00010000:00010000:3.0:1787847365.954462:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847365.954484:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0beb expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.954842:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.954856:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.954874:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.954890:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.954897:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.954904:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787847365.955791:0:7214:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787847365.956079:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861d01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956091:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956100:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861d01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956132:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956139:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956146:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956152:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847365.956163:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956170:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956183:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:3.0:1787847365.956186:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847365.956192:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956199:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861cf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847365.956211:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039d4f91f reply state 00000000e03b7582 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847365.956220:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787847365.956254:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861cec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0beb expref: 10 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956268:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861d01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0beb expref: 9 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.956275:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c3361800) 00010000:00010000:3.0:1787847365.956277:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847365.956279:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847365.956353:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1363840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:9662:x1874693595350528:12345-192.168.201.21@tcp:101:touch.500 Request processed in 1915us (2134us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787847365.956362:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:2.0:1787847365.967085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:1.0:1787847365.967196:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.967210:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.967218:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.967225:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847365.967230:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.967238:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.967260:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4588ff08 (ffff8d87c3361f00) 00010000:00010000:1.0:1787847365.967262:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847365.967267:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847365.967275:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861cfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847365.967889:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595350784 00000100:00100000:0.0:1787847365.967903:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595350784 00000100:00100000:0.0:1787847365.967990:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:0.0:1787847365.968000:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:9662:x1874693595350784:12345-192.168.201.21@tcp:36:touch.500 00010000:00010000:0.0:1787847365.968059:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847365.968081:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861d01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0beb expref: 9 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.968094:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c3361800) 00010000:00010000:0.0:1787847365.968101:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847365.968155:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.968169:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847365.968180:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847365.968310:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b4bd684 reply state 00000000c9f3ebd2 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847365.968319:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787847365.968427:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:9662:x1874693595350784:12345-192.168.201.21@tcp:36:touch.500 Request processed in 427us (1353us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787847365.968435:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:0.0:1787847365.971615:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847365.971871:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595350912 00000100:00100000:3.0:1787847365.971882:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595350912 00000100:00100000:3.0:1787847365.971984:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1787847365.971995:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:9662:x1874693595350912:12345-192.168.201.21@tcp:101:touch.500 00010000:00010000:3.0:1787847365.972019:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847365.972041:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861d16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bf2 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.972101:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bf2 expref: 11 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.972114:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861d16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bf2 expref: 11 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847365.972133:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c7207400) 00010000:00010000:3.0:1787847365.972137:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847365.972140:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7000, rc 0) 00000100:00100000:3.0:1787847365.972199:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1361680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:9662:x1874693595350912:12345-192.168.201.21@tcp:101:touch.500 Request processed in 205us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847365.972206:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00010000:00010000:2.0:1787847365.972696:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.972707:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.972714:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.972721:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847365.972725:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.972734:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.972747:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c7207400) 00010000:00010000:2.0:1787847365.972751:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847365.972755:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847365.972761:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff800/0x1835de88b9861d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847365.978786:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847365.978871:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595351040 00000100:00100000:0.0:1787847365.978882:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595351040 00000100:00100000:0.0:1787847365.978969:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1787847365.978986:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1874693595351040:12345-192.168.201.21@tcp:8:touch.500 00010000:00080000:0.0:1787847365.979021:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:0.0:1787847365.979052:0:6679:0:(genops.c:1385:class_connect()) connect: client 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3, cookie 0x1835de88b9861d1d 00002000:00100000:0.0:1787847365.979065:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3/ffff8d87ef5da800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787847365.979076:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787847365.979320:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787847365.979355:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d8800367800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787847365.979446:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bda940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2343:x1874693595351040:12345-192.168.201.21@tcp:8:touch.500 Request processed in 459us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847365.979472:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:1.0:1787847365.982102:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847365.982250:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595351168 00000100:00100000:2.0:1787847365.982260:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595351168 00000100:00080000:1.0:1787847365.982309:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847365.982390:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1787847365.982402:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:0:x1874693595351168:12345-192.168.201.21@tcp:2:touch.500 00000001:00100000:1.0:1787847366.018595:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000100:00100000:3.0:1787847366.018858:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:0:x1874693595351168:12345-192.168.201.21@tcp:2:touch.500 Request processed in 36452us (36758us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787847366.018870:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1787847366.021433:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847366.021990:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595351424 00000100:00100000:0.0:1787847366.022001:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595351424 00000100:00100000:0.0:1787847366.022061:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:0.0:1787847366.022072:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:9662:x1874693595351424:12345-192.168.201.21@tcp:35:touch.500 00000100:00100000:0.0:1787847366.022421:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:9662:x1874693595351424:12345-192.168.201.21@tcp:35:touch.500 Request processed in 350us (995us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787847366.022428:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000001:00080000:1.0:1787847366.023233:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1787847366.036223:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847366.036335:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595351552 00000100:00100000:2.0:1787847366.036346:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595351552 00000100:00100000:2.0:1787847366.036434:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1787847366.036444:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:9663:x1874693595351552:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:2.0:1787847366.036472:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847366.036494:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0bf9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.036573:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b000/0x1835de88b9861d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.036587:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b000/0x1835de88b9861d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.036598:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b000/0x1835de88b9861d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847366.036656:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787847366.036659:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847366.036702:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b000/0x1835de88b9861d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.036730:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bf9 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.036749:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b000/0x1835de88b9861d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bf9 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.036757:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:2.0:1787847366.036759:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847366.036763:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b000, rc 0) 00000100:00100000:2.0:1787847366.036830:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1362d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:9663:x1874693595351552:12345-192.168.201.21@tcp:101:rm.0 Request processed in 387us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847366.036844:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1787847366.041577:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847366.041650:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595351808 00000100:00100000:3.0:1787847366.041661:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595351808 00000100:00100000:3.0:1787847366.041720:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:3.0:1787847366.041730:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:9663:x1874693595351808:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:3.0:1787847366.041768:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847366.041791:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c00 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847366.041905:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787847366.042117:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d32 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c00 expref: 14 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.042132:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:3.0:1787847366.042134:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847366.042139:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c00 expref: 14 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.042151:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847366.042205:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:9663:x1874693595351808:12345-192.168.201.21@tcp:101:rm.0 Request processed in 476us (638us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787847366.042212:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:3.0:1787847366.048024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847366.048349:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595351936 00000100:00100000:0.0:1787847366.048359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595351936 00000100:00100000:0.0:1787847366.048425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:0.0:1787847366.048436:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:9663:x1874693595351936:12345-192.168.201.21@tcp:37:rm.0 00000100:00100000:0.0:1787847366.054138:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:9663:x1874693595351936:12345-192.168.201.21@tcp:37:rm.0 Request processed in 5692us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847366.054154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1787847366.058189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847366.058305:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595352192 00000100:00100000:0.0:1787847366.058316:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595352192 00000100:00100000:0.0:1787847366.058384:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:0.0:1787847366.058395:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e97b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:9663:x1874693595352192:12345-192.168.201.21@tcp:35:rm.0 00000100:00100000:0.0:1787847366.058663:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e97b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:9663:x1874693595352192:12345-192.168.201.21@tcp:35:rm.0 Request processed in 269us (483us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787847366.058671:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:3.0:1787847366.062211:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847366.062326:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595352448 00000100:00100000:2.0:1787847366.062336:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595352448 00000100:00100000:2.0:1787847366.062404:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:2.0:1787847366.062413:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:9663:x1874693595352448:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:2.0:1787847366.062437:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847366.062458:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861d40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c07 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.062587:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861d47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.062601:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.062612:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861d47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847366.062624:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787847366.062741:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861d40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c07 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.062760:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861d47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c07 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.062768:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:2.0:1787847366.062770:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787847366.062788:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847366.062852:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595352448:12345-192.168.201.21@tcp:101:rm.0 Request processed in 439us (650us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787847366.062860:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:2.0:1787847366.066397:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847366.066462:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595352576 00000100:00100000:3.0:1787847366.066471:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595352576 00000100:00100000:3.0:1787847366.066525:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:3.0:1787847366.066534:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595352576:12345-192.168.201.21@tcp:41:rm.0 00000004:00000024:3.0:1787847366.066587:0:7214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787847366.066653:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595352576:12345-192.168.201.21@tcp:41:rm.0 Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847366.066674:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:1.0:1787847366.069570:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847366.069679:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595352704 00000100:00100000:2.0:1787847366.069688:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595352704 00000100:00100000:2.0:1787847366.069744:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:2.0:1787847366.069754:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595352704:12345-192.168.201.21@tcp:101:rm.0 00010000:00010000:2.0:1787847366.069773:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847366.069791:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861d55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c0e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.069852:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.069865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.069875:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.069889:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.069896:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.069902:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070054:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070062:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070069:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847366.070097:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787847366.070102:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847366.070117:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070129:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070137:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070143:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070150:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070156:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847366.070160:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070167:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070186:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:2.0:1787847366.070189:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847366.070194:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070201:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070214:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070220:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070225:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070230:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847366.070233:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070239:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070246:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4588ff08 (ffff8d87c4d7f900) 00010000:00010000:2.0:1787847366.070248:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847366.070251:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070257:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070295:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861d55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c0e expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070308:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c0e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.070315:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c7207400) 00010000:00010000:2.0:1787847366.070317:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847366.070320:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b800, rc 0) 00000100:00100000:2.0:1787847366.070371:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+17:9663:x1874693595352704:12345-192.168.201.21@tcp:101:rm.0 Request processed in 618us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847366.070378:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:1.0:1787847366.074373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847366.074470:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595352960 00000100:00100000:3.0:1787847366.074481:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595352960 00000100:00100000:3.0:1787847366.074543:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:3.0:1787847366.074554:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+17:9663:x1874693595352960:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:3.0:1787847366.074615:0:7214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787847366.074643:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861d6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c0e expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074663:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7000/0x1835de88b9861d16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bf2 expref: 16 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074673:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c7207400) 00010000:00010000:3.0:1787847366.074687:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b000/0x1835de88b9861d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bf9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074694:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:3.0:1787847366.074697:0:7214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847366.074716:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074729:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074738:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074752:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074772:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074778:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074889:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074897:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.074904:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787847366.075632:0:7214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787847366.075644:0:7214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 280899711220ns, next at 281899708759ns, rc = 0 00010000:00010000:3.0:1787847366.075703:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075713:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075721:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075728:0:7214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075734:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075753:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075765:0:7214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787847366.075785:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075792:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075798:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075805:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847366.075809:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075817:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075826:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:3.0:1787847366.075829:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787847366.075833:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075838:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7800/0x1835de88b9861d7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075853:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075859:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075870:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075875:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847366.075877:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075883:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075890:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:3.0:1787847366.075892:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847366.075895:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.075900:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861d71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847366.075909:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001968aa6 reply state 000000006853fe96 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847366.075917:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847366.076039:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595352960:12345-192.168.201.21@tcp:36:rm.0 Request processed in 1484us (1673us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787847366.076047:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00010000:00010000:1.0:1787847366.076357:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847366.076365:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847366.076372:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847366.076375:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847366.076381:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847366.076390:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:1.0:1787847366.076393:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787847366.076396:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847366.076401:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861d86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847366.076416:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847366.076418:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847366.076419:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847366.078904:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.078965:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.078981:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.078987:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847366.078991:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.078999:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.079014:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x4588ff08 (ffff8d87c3361000) 00010000:00010000:0.0:1787847366.079017:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847366.079022:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.079028:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861d78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x4588ff08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847366.082430:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847366.082575:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595353216 00000100:00100000:0.0:1787847366.082585:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595353216 00000100:00100000:0.0:1787847366.082643:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:0.0:1787847366.082653:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:9663:x1874693595353216:12345-192.168.201.21@tcp:35:rm.0 00000100:00100000:0.0:1787847366.082902:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595353216:12345-192.168.201.21@tcp:35:rm.0 Request processed in 250us (481us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787847366.082910:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:1.0:1787847366.086148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847366.086247:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595353472 00000100:00100000:2.0:1787847366.086256:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595353472 00000100:00100000:2.0:1787847366.086314:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:2.0:1787847366.086325:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:9663:x1874693595353472:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:2.0:1787847366.086394:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787847366.086423:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c07 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086444:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0be4 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086454:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c7207300) 00010000:00010000:2.0:1787847366.086469:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861ca6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bd6 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086496:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:2.0:1787847366.086504:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847366.086527:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086538:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086561:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086567:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086573:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086866:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086875:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.086882:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847366.087548:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787847366.087566:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087580:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087587:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087592:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847366.087596:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087603:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087613:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d87c4d7fe00) 00010000:00010000:2.0:1787847366.087616:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787847366.087620:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087626:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861d9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087644:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087650:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087656:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087661:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847366.087670:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087676:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087685:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:2.0:1787847366.087687:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847366.087690:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847366.087696:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861d8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847366.087709:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006355424d reply state 00000000a3b88fac transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847366.087719:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847366.087791:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:9663:x1874693595353472:12345-192.168.201.21@tcp:36:rm.0 Request processed in 1466us (1649us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787847366.087799:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00010000:00010000:0.0:1787847366.091241:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.091274:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.091281:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.091288:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847366.091292:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.091300:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.091320:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d87c4d7f000) 00010000:00010000:0.0:1787847366.091323:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847366.091328:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847366.091335:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861d94 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847366.103356:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847367.129328:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847367.604895:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847367.606808:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847367.606854:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847367.606877:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847367.606919:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595353728 00000100:00100000:1.0:1787847367.606973:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595353728 00000100:00100000:1.0:1787847367.607038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595353984 00000100:00100000:1.0:1787847367.607042:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595353984 00000100:00100000:1.0:1787847367.607065:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:1.0:1787847367.607076:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:2344:x1874693595353728:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847367.607154:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:2344:x1874693595353728:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847367.607161:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:1.0:1787847367.607178:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:1.0:1787847367.607184:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595353984:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847367.607210:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595353984:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 26us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847367.607215:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00080000:1.0:1787847367.607232:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847367.607414:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595353856 00000100:00100000:3.0:1787847367.607418:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595353856 00000100:00100000:3.0:1787847367.607462:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:3.0:1787847367.607471:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595353856:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847367.607512:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595353856:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 44us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847367.607519:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00080000:1.0:1787847367.607604:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847367.615269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595353600 00000100:00100000:2.0:1787847367.615285:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595353600 00000100:00100000:2.0:1787847367.615363:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 247 00000100:00100000:2.0:1787847367.615374:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595353600:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847367.615455:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595353600:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 82us (10569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847367.615462:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 247 00000100:00100000:1.0:1787847367.769277:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616358400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847367.769365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847367.774666:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358400 00000100:00100000:1.0:1787847367.774682:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358400 00000100:00100000:1.0:1787847367.778674:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787847367.778692:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616358400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847367.778733:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847367.778809:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616358400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (9444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847367.778816:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787847367.778865:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87efbc4b40 x1874693616358400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847367.778902:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616358400:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787847367.786244:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787847368.151200:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847369.176096:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847369.307135:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616358912:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307202:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847369.307258:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787847369.307264:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616358528:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847369.307316:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616359040:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847369.307368:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616358784:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847369.307408:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787847369.307413:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616358656:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847369.307457:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616359168:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847369.307503:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358912 00000100:00100000:2.0:1787847369.307510:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358912 00000100:00100000:2.0:1787847369.307556:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616359168 00000100:00100000:2.0:1787847369.307559:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616359168 00000100:00100000:2.0:1787847369.307581:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787847369.307590:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616358912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307641:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616358912:12345-0@lo:400:kworker.0 Request processed in 52us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847369.307648:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787847369.307664:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787847369.307669:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616359168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307699:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616359168:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847369.307712:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787847369.307730:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358528 00000100:00100000:2.0:1787847369.307734:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358528 00000100:00100000:2.0:1787847369.307757:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787847369.307763:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616358528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307792:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616358528:12345-0@lo:400:kworker.0 Request processed in 29us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847369.307798:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787847369.307823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616359040 00000100:00100000:2.0:1787847369.307826:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616359040 00000100:00100000:2.0:1787847369.307849:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358784 00000100:00100000:2.0:1787847369.307851:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358784 00000100:00100000:2.0:1787847369.307862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616358656 00000100:00100000:2.0:1787847369.307864:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616358656 00000100:00100000:2.0:1787847369.307875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787847369.307881:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616359040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.307910:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616359040:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847369.307948:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787847369.307962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787847369.307969:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616358784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.308008:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616358784:12345-0@lo:400:kworker.0 Request processed in 40us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847369.308015:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787847369.308027:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787847369.308032:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616358656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.308063:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616358656:12345-0@lo:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847369.308069:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787847369.308117:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616358656:0@lo:400:kworker.0 00010000:00080000:2.0:1787847369.308131:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87efbc6940 x1874693616359168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847369.308141:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616359168:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.308150:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616358784:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.308180:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616358528:0@lo:400:kworker.0 00000100:00100000:2.0:1787847369.308189:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616359040:0@lo:400:kworker.0 00010000:00080000:2.0:1787847369.308198:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87efbc4000 x1874693616358912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847369.308206:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616358912:0@lo:400:kworker.0 00000100:00080000:3.0:1787847369.308533:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847369.308538:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847369.308540:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1787847369.338459:0:11607:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:1.0:1787847369.818836:0:7915:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 284642901323ns, next at 285642898810ns, rc = 0 00000100:00100000:1.0:1787847369.818889:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616359296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847369.818979:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847369.819062:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616359296 00000100:00100000:1.0:1787847369.819070:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616359296 00000100:00100000:1.0:1787847369.819115:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787847369.819125:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616359296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847369.819175:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847369.819217:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616359296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847369.819225:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787847369.819266:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9ce2580 x1874693616359296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847369.819284:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616359296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787847370.204593:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787847370.446541:0:11655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffccdb3bd10 20000000:00000080:3.0:1787847370.446560:0:11655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d87c6b8a400 uarg=0000000000000000 20000000:01000000:3.0:1787847370.446597:0:11655:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787847370.446602:0:11655:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787847370.446608:0:11655:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787847370.447304:0:11656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787847370.447537:0:11655:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787847370.452911:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787847370.452999:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787847370.453056:0:11655:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787847370.453073:0:11655:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787847370.453093:0:11655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453113:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453122:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453131:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861c52 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453152:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861c60 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453159:0:11655:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861c6e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453166:0:11655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453210:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861c6e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.453225:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861c6e expref: 18 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.453240:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ae940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359424:0@lo:104: 00000100:00100000:3.0:1787847370.455400:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787847370.455526:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861c60 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.455540:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861c60 expref: 18 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.455554:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b061c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359552:0@lo:104: 00000100:00100000:3.0:1787847370.455610:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787847370.458105:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9861c52 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.458122:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9861c52 expref: 18 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.458151:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359680:0@lo:104: 00000100:00100000:3.0:1787847370.458204:0:11655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847370.458295:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616359424 00000100:00100000:0.0:1787847370.458558:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616359424 00000100:00100000:0.0:1787847370.458600:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616359552 00000100:00100000:0.0:1787847370.458603:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616359552 00000100:00100000:0.0:1787847370.458622:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787847370.458812:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:11655:x1874693616359424:12345-0@lo:104: 00010000:00010000:0.0:1787847370.458829:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847370.458948:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787847370.458954:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:11655:x1874693616359424:12345-0@lo:104: Request processed in 146us (3558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847370.458961:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787847370.458976:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787847370.458982:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:11655:x1874693616359552:12345-0@lo:104: 00010000:00010000:0.0:1787847370.458989:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847370.459086:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787847370.459098:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00010000:00010000:3.0:1787847370.459102:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847370.459103:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1787847370.459114:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 12 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.459125:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359808:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847370.459178:0:11655:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.459185:0:11655:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.459192:0:11655:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359936:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847370.459211:0:11655:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7202d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847370.459231:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ae940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359424:0@lo:104: 00000100:00100000:3.0:1787847370.459239:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b061c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359552:0@lo:104: 00000100:00100000:3.0:1787847370.459516:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616359680 00000100:00100000:3.0:1787847370.459521:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616359680 00000100:00100000:2.0:1787847370.459616:0:11657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847370.459624:0:11657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880035e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:11655:x1874693616359680:12345-0@lo:104: 00010000:00010000:2.0:1787847370.459750:0:11657:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.459916:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359680:0@lo:104: 00000100:00100000:3.0:1787847370.461979:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359808:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847370.463655:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787847370.463668:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463678:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847370.463682:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463691:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847370.463719:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847370.463725:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787847370.463783:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463790:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847370.463819:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463827:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165c800/0x1835de88b9861c6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463841:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787847370.463844:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463849:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847370.463852:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463858:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847370.463865:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847370.463869:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787847370.463890:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463906:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847370.463912:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463919:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165c200/0x1835de88b9861c60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c67 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463927:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847370.463945:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463951:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847370.463954:0:7622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463961:0:7622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847370.463967:0:7622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847370.463971:0:7622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787847370.463984:0:7622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.463989:0:7622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847370.464004:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.464021:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c6afe600/0x1835de88b9861c52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9861c59 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.464307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847370.464342:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847370.464387:0:11655:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11655:1874693616359936:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847370.464439:0:11655:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.465023:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847370.465027:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847370.465030:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847370.465049:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616360064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847370.465106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847370.465150:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847370.465157:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616360192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847370.465179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847370.465215:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616360320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847370.465254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847370.465288:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354112 00000100:00100000:1.0:1787847370.465293:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354112 00010000:00010000:1.0:1787847370.465336:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 13 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847370.465358:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354240 00000100:00100000:1.0:1787847370.465361:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354240 00010000:00010000:1.0:1787847370.465373:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 14 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847370.465383:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360064 00000100:00100000:1.0:1787847370.465385:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360064 00010000:00010000:1.0:1787847370.465396:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861c6e expref: 19 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847370.465421:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360192 00000100:00100000:3.0:1787847370.465494:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360320 00000100:00100000:3.0:1787847370.465498:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360320 00010000:00010000:3.0:1787847370.465512:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861c52 expref: 20 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847370.465527:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:3.0:1787847370.465534:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69bd20f9-b82b-4055-8d65-e297ac8f20aa+14:2346:x1874693595354112:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847370.465547:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847370.465552:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 14 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465561:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 14 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465579:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165d200/0x1835de88b9861c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc8 expref: 14 pid: 5838 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465592:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847370.465633:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595354112:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 99us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847370.465641:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:3.0:1787847370.465656:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:3.0:1787847370.465662:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:2346:x1874693595354240:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847370.465668:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847370.465673:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465686:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465695:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165dc00/0x1835de88b9861c44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0bc1 expref: 12 pid: 5835 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465703:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847370.465718:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:2346:x1874693595354240:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 56us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847370.465723:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:3.0:1787847370.465734:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787847370.465740:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419007c4-9cf4-45fe-a98f-f6eaa183effb+20:3302:x1874693616360064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847370.465748:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847370.465752:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861c6e expref: 20 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465761:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861c6e expref: 20 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465770:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165c400/0x1835de88b9861c75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861c6e expref: 20 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465779:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847370.465807:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616360064:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847370.465813:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787847370.465844:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787847370.465850:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3300:x1874693616360320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847370.465878:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847370.465883:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861c52 expref: 18 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465890:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861c52 expref: 18 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465909:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165d600/0x1835de88b9861c59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861c52 expref: 18 pid: 5838 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.465918:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847370.465956:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:3300:x1874693616360320:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847370.465962:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:0.0:1787847370.466391:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1787847370.466401:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+4:11655:x1874693616359552:12345-0@lo:104: Request processed in 7417us (10788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847370.466411:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787847370.466577:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360192 00010000:00010000:1.0:1787847370.466598:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861c60 expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847370.466628:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787847370.466634:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:3302:x1874693616360192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787847370.466642:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847370.466646:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9861c60 expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466656:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9861c60 expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466666:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165cc00/0x1835de88b9861c67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9861c60 expref: 17 pid: 5835 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466678:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466687:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466703:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466709:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466716:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466731:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466737:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847370.466741:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466750:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466762:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847370.466772:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847370.466802:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3302:x1874693616360192:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847370.466808:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787847370.466849:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616360192:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847370.467018:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847370.467057:0:11655:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.467066:0:11655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847370.467072:0:11655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9861da2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847370.467987:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616360064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847370.468026:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616360320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787847370.471351:0:11657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787847370.471368:0:11657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880035e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:419007c4-9cf4-45fe-a98f-f6eaa183effb+3:11655:x1874693616359680:12345-0@lo:104: Request processed in 11741us (13159us total) trans 0 rc 0/0 00010000:00010000:3.0:1787847370.471382:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847370.471402:0:11657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787847371.223589:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787847371.419022:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1787847371.419044:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1787847371.420067:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787847371.420092:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787847371.422965:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616360448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787847371.423040:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847371.423097:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360448 00000100:00100000:3.0:1787847371.423106:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360448 00000100:00100000:3.0:1787847371.423185:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787847371.423195:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616360448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787847371.423223:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787847371.423255:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9062c6, atime: 0x6a9062c6, ctime: 0x6a9062c6, blocks: 0x1 00010000:00010000:3.0:1787847371.423263:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847371.423280:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=286s v=(0 0) 00010000:00010000:3.0:1787847371.423284:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847371.423291:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847371.423308:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847371.423318:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847371.423326:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847371.423349:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787847371.423415:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847371.423421:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847371.423447:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847371.423451:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847371.423459:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847371.423478:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847371.423485:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e1c7aa8/0x1835de88b9861da9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847371.423504:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847371.423506:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847371.423507:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847371.423901:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ced2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616360448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 705us (859us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787847371.423910:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1787847371.424247:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787847371.427641:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87efbc4000/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787847371.427656:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616360448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787847372.017661:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847372.021146:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354368 00000100:00100000:2.0:1787847372.021165:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354368 00000100:00100000:2.0:1787847372.021254:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 249 00000100:00100000:2.0:1787847372.021265:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:5587:x1874693595354368:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847372.021293:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847372.021316:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c15 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847372.021348:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c15 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847372.021359:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c15 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847372.021368:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ba00, rc 0) 00000100:00100000:2.0:1787847372.021443:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595354368:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 179us (3792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.021450:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 249 00000100:00100000:3.0:1787847372.037288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847372.037572:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354496 00000100:00100000:2.0:1787847372.037583:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354496 00000100:00100000:2.0:1787847372.037647:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 250 00000100:00100000:2.0:1787847372.037657:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595354496:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847372.038005:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595354496:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 348us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.038014:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 250 00000100:00100000:0.0:1787847372.042240:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847372.042339:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354624 00000100:00100000:3.0:1787847372.042351:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354624 00000100:00100000:3.0:1787847372.042414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 251 00000100:00100000:3.0:1787847372.042424:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595354624:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.042668:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595354624:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 244us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.042676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 251 00000100:00100000:3.0:1787847372.049026:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847372.049116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354752 00000100:00100000:0.0:1787847372.049126:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354752 00000100:00100000:0.0:1787847372.049190:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 252 00000100:00100000:0.0:1787847372.049202:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:9933:x1874693595354752:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787847372.049483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:9933:x1874693595354752:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 282us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847372.049491:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 252 10000000:01000000:3.0:1787847372.055336:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787847372.055346:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ff957000 from 7 10000000:01000000:3.0:1787847372.055350:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787847372.055412:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.055424:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.055436:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847372.055611:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616360576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.055694:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.055766:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c72026c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847372.055964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360576 00000100:00100000:2.0:1787847372.055974:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360576 00000100:00100000:2.0:1787847372.056170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787847372.056182:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:5840:x1874693616360576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847372.056197:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787847372.056211:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:2.0:1787847372.056213:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b000/0x1835de88b9861dbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861db7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847372.056238:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b000/0x1835de88b9861dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861db7 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847372.056249:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b000/0x1835de88b9861dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861db7 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847372.056258:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b000, rc 0) 00000100:00100000:2.0:1787847372.056312:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616360576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.056319:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787847372.056346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595354880 00000100:00100000:2.0:1787847372.056349:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595354880 00000100:00100000:2.0:1787847372.056364:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 254 00000100:00100000:2.0:1787847372.056370:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:9933:x1874693595354880:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787847372.056581:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:9933:x1874693595354880:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 209us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.056589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 254 00000100:00100000:0.0:1787847372.056982:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616360576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847372.056999:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847372.057091:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847372.057155:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616360704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847372.057193:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847372.057227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360704 00000100:00100000:0.0:1787847372.057229:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbcc300 going to sleep for 11 seconds 00000100:00100000:2.0:1787847372.057234:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360704 00000100:00100000:2.0:1787847372.057361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787847372.057377:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616360704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847372.057741:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c82b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616360704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.057756:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787847372.057828:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616360704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847372.057858:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616360832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847372.057902:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847372.076595:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbcc300 going to sleep for 11 seconds 00000100:00100000:0.0:1787847372.080672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847372.084003:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360832 00000100:00100000:3.0:1787847372.084030:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360832 00000100:00100000:3.0:1787847372.084095:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787847372.084106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616360832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.084371:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616360832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (26467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.084380:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787847372.086178:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616360832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.086541:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11670:1874693616360960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.086624:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.086659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616360960 00000100:00100000:3.0:1787847372.086664:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616360960 00000100:00100000:3.0:1787847372.086696:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787847372.086706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:11670:x1874693616360960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.086921:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:11670:x1874693616360960:12345-0@lo:502:llog_process_th.0 Request processed in 215us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.086929:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787847372.087081:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c72023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.087099:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11670:1874693616360960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847372.087122:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847372.087131:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847372.087133:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787847372.087139:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d87ff957000 00000020:00000080:3.0:1787847372.087141:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787847372.087227:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11670:1874693616361088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.087264:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.087283:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c72023c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847372.087823:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361088 00000100:00100000:2.0:1787847372.087830:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361088 00000100:00100000:2.0:1787847372.087888:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787847372.087898:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:11670:x1874693616361088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847372.088256:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355008 00000100:00100000:2.0:1787847372.088263:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:11670:x1874693616361088:12345-0@lo:502:llog_process_th.0 Request processed in 364us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847372.088263:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355008 00000100:00100000:2.0:1787847372.088274:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787847372.088367:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11670:1874693616361088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847372.088390:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847372.088401:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847372.088404:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787847372.088408:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1787847372.088414:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 259 00000100:00100000:0.0:1787847372.088425:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:5587:x1874693595355008:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847372.088436:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847372.088525:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff800/0x1835de88b9861dc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c1c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1787847372.088544:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 00010000:00010000:0.0:1787847372.088552:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff800/0x1835de88b9861dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c1c expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847372.088564:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff800/0x1835de88b9861dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c1c expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847372.088565:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787847372.088577:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff800, rc 0) 00010000:00010000:3.0:1787847372.088578:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.088592:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847372.088604:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787847372.088607:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87ef8a4000 from 7 00000100:00100000:0.0:1787847372.088629:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595355008:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 206us (8240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847372.088636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 259 10000000:01000000:3.0:1787847372.094705:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787847372.094754:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.094766:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.094777:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847372.094803:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.095753:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.095800:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c72023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.095827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361216 00000100:00100000:3.0:1787847372.095834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361216 00000100:00100000:3.0:1787847372.095888:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787847372.095899:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+17:5840:x1874693616361216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847372.095913:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847372.095960:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861dd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861dcc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.095987:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861dcc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.096001:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861dcc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.096010:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6e00, rc 0) 00000100:00100000:3.0:1787847372.096058:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616361216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.096066:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787847372.096653:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847372.096686:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355136 00000100:00100000:2.0:1787847372.096692:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355136 00000100:00100000:2.0:1787847372.096733:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 261 00000100:00100000:2.0:1787847372.096743:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595355136:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.099722:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847372.099753:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.099766:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847372.099838:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.099906:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.099963:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c72023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.099982:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361344 00000100:00100000:3.0:1787847372.099987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361344 00000100:00100000:2.0:1787847372.100308:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595355136:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 3564us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.100318:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 261 00000100:00100000:3.0:1787847372.100426:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787847372.100435:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616361344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.100789:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616361344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 355us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.100801:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787847372.100841:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847372.100891:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f37840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847372.100968:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847372.100992:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361472 00000100:00100000:2.0:1787847372.100999:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361472 00000100:00100000:0.0:1787847372.101001:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbccb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847372.101124:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787847372.101132:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616361472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847372.101287:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616361472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.101304:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787847372.101326:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f37840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847372.107438:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847372.108387:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355264 00000100:00100000:3.0:1787847372.108399:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355264 00000100:00100000:3.0:1787847372.108535:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 264 00000100:00100000:3.0:1787847372.108547:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595355264:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.109571:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:5587:x1874693595355264:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 1021us (2139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.109582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 264 00000100:00100000:3.0:1787847372.109969:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11673:1874693616361600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.110037:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.110080:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7202cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847372.110335:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361600 00000100:00100000:2.0:1787847372.110341:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361600 00000100:00100000:2.0:1787847372.110381:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787847372.110390:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:11673:x1874693616361600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847372.110699:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:11673:x1874693616361600:12345-0@lo:502:llog_process_th.0 Request processed in 310us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.110707:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787847372.111705:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11673:1874693616361600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847372.111740:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847372.111750:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847372.111753:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787847372.111758:0:11673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d87ef8a4000 00000020:00000080:3.0:1787847372.111761:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787847372.111897:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11673:1874693616361728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.111964:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.111998:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7202cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847372.112584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361728 00000100:00100000:2.0:1787847372.112592:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361728 00000100:00100000:2.0:1787847372.112656:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787847372.112665:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:11673:x1874693616361728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847372.112882:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:11673:x1874693616361728:12345-0@lo:502:llog_process_th.0 Request processed in 217us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.112890:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787847372.115263:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11673:1874693616361728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847372.115299:0:11673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847372.115310:0:11673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847372.115312:0:11673:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787847372.115316:0:11673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787847372.115412:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787847372.115430:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787847372.115441:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847372.115451:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847372.115472:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787847372.115475:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87d0568000 from 7 10000000:01000000:1.0:1787847372.115478:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787847372.115514:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847372.115522:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847372.115531:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847372.115551:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cee940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787847372.115621:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847372.115663:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c20a50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.115812:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361856 00000100:00100000:3.0:1787847372.115818:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361856 00000100:00100000:3.0:1787847372.115855:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787847372.115863:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:5840:x1874693616361856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847372.115887:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847372.115899:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861de1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9861dda expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847372.115910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:3.0:1787847372.115924:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861de1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9861dda expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.115954:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861de1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9861dda expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.115964:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7e00, rc 0) 00000100:00100000:3.0:1787847372.115981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355392 00000100:00100000:3.0:1787847372.115984:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355392 00000100:00100000:3.0:1787847372.115998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 268 00000100:00100000:3.0:1787847372.116001:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:9936:x1874693595355392:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787847372.116160:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:9936:x1874693595355392:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 155us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.116168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 268 00000100:00100000:3.0:1787847372.116215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616361856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 353us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.116221:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787847372.116242:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cee940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847372.116254:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.116267:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847372.116314:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.116342:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.116372:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7202180 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.116388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616361984 00000100:00100000:3.0:1787847372.116391:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616361984 00000100:00100000:3.0:1787847372.116424:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787847372.116431:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616361984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.116617:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616361984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.116624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787847372.116660:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616361984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847372.116687:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ceed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616362112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847372.116719:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847372.116740:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d86c20a5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.117556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362112 00000100:00100000:3.0:1787847372.117563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362112 00000100:00100000:3.0:1787847372.117588:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787847372.117592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616362112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847372.117725:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:5840:x1874693616362112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.117734:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1787847372.117757:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ceed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:419007c4-9cf4-45fe-a98f-f6eaa183effb:5840:1874693616362112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787847372.118656:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787847372.118815:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11675:1874693616362240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847372.118887:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847372.118956:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6900 going to sleep for 11 seconds 00000100:00100000:1.0:1787847372.119010:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362240 00000100:00100000:1.0:1787847372.119016:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362240 00000100:00100000:1.0:1787847372.119094:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787847372.119104:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:11675:x1874693616362240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787847372.119331:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:11675:x1874693616362240:12345-0@lo:502:llog_process_th.0 Request processed in 228us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847372.119339:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787847372.120388:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11675:1874693616362240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787847372.120427:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847372.120438:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847372.120441:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787847372.120449:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d87d0568000 00000020:00000080:2.0:1787847372.120452:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787847372.120557:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11675:1874693616362368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.120728:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847372.120820:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355520 00000100:00100000:0.0:1787847372.120826:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355520 00000100:00100000:0.0:1787847372.120877:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 272 00000100:00100000:0.0:1787847372.120886:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:9936:x1874693595355520:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787847372.121501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:9936:x1874693595355520:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 611us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847372.121510:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 272 00000100:00100000:2.0:1787847372.122712:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847372.122753:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6fa6900 going to sleep for 11 seconds 00000100:00100000:3.0:1787847372.122805:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362368 00000100:00100000:3.0:1787847372.122813:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362368 00000100:00100000:3.0:1787847372.122859:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1787847372.122883:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:11675:x1874693616362368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847372.123294:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:11675:x1874693616362368:12345-0@lo:502:llog_process_th.0 Request processed in 423us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.123301:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787847372.123541:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc52c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:419007c4-9cf4-45fe-a98f-f6eaa183effb:11675:1874693616362368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787847372.123577:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787847372.123584:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787847372.123587:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787847372.123594:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787847372.123787:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787847372.123805:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847372.123816:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.123827:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847372.247321:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847372.720132:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847372.721511:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847372.721618:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847372.721883:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355776 00000100:00100000:2.0:1787847372.721892:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355776 00000100:00100000:2.0:1787847372.721985:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1787847372.721996:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595355776:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847372.722069:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ceed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595355776:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 76us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847372.722077:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00080000:0.0:1787847372.722281:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847372.726575:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355648 00000100:00100000:3.0:1787847372.726754:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355648 00000100:00100000:3.0:1787847372.726861:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595355904 00000100:00100000:3.0:1787847372.726865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595355904 00000100:00100000:3.0:1787847372.726901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:1.0:1787847372.726912:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:3.0:1787847372.726914:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595355648:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847372.727016:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595355648:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 105us (5508us total) trans 0 rc 0/0 00000100:00080000:0.0:1787847372.727071:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847372.727889:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595355904:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847372.728065:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595355904:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 185us (6445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.728563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:1.0:1787847372.742332:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:1.0:1787847372.888293:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616362496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847372.888369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847372.888693:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362496 00000100:00100000:3.0:1787847372.888701:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362496 00000100:00100000:3.0:1787847372.888761:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787847372.888925:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616362496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847372.888986:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787847372.889420:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847372.889788:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616362496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 865us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847372.889811:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787847372.890154:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87efbc43c0 x1874693616362496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847372.890179:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616362496:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787847373.145239:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787847373.271195:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847374.295401:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847374.423386:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616362752:0@lo:400:kworker.0 00000100:00100000:1.0:1787847374.423386:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616362880:0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.423464:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847374.423521:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616362624:0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.423526:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616363264:0@lo:400:kworker.0 00000100:00100000:2.0:1787847374.423618:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616363008:0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.428801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847374.428917:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363264 00000100:00100000:3.0:1787847374.428925:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363264 00000100:00100000:3.0:1787847374.429001:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787847374.429010:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616363264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.429075:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616363264:12345-0@lo:400:kworker.0 Request processed in 66us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847374.429082:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787847374.429109:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362752 00000100:00100000:3.0:1787847374.429113:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362752 00000100:00100000:3.0:1787847374.429137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787847374.429142:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616362752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.429174:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616362752:12345-0@lo:400:kworker.0 Request processed in 32us (5712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847374.429180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787847374.429461:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616362752:0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.429474:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616363264:0@lo:400:kworker.0 00000100:00080000:3.0:1787847374.429516:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847374.434426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847374.434514:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616363136:0@lo:400:kworker.0 00000100:00100000:0.0:1787847374.434578:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847374.435707:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362624 00000100:00100000:3.0:1787847374.435733:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362624 00000100:00100000:3.0:1787847374.435799:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787847374.435809:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616362624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.435894:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616362624:12345-0@lo:400:kworker.0 Request processed in 86us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847374.435902:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1787847374.435981:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363136 00000100:00100000:3.0:1787847374.435985:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363136 00000100:00100000:3.0:1787847374.436025:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787847374.436033:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616363136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.436063:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616363136:12345-0@lo:400:kworker.0 Request processed in 32us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847374.436069:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787847374.436083:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847374.437431:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616362624:0@lo:400:kworker.0 00000100:00100000:0.0:1787847374.437455:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616363136:0@lo:400:kworker.0 00000100:00100000:1.0:1787847374.438332:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847374.438449:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616362880 00000100:00100000:3.0:1787847374.438457:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616362880 00000100:00100000:3.0:1787847374.438518:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787847374.438526:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ceda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.438748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ceda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616362880:12345-0@lo:400:kworker.0 Request processed in 221us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847374.438755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1787847374.439001:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847374.440019:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616362880:0@lo:400:kworker.0 00000100:00100000:2.0:1787847374.443432:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847374.444710:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363008 00000100:00100000:3.0:1787847374.444722:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363008 00000100:00100000:3.0:1787847374.444804:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787847374.444814:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616363008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847374.444899:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616363008:12345-0@lo:400:kworker.0 Request processed in 86us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847374.444921:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:1.0:1787847374.447128:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9cede00 x1874693616363008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847374.447148:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616363008:0@lo:400:kworker.0 00000100:00080000:0.0:1787847374.448769:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847374.936756:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616363392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847374.936844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847374.936963:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363392 00000100:00100000:0.0:1787847374.936972:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363392 00000100:00100000:0.0:1787847374.937022:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787847374.937031:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616363392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847374.937071:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847374.937135:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616363392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847374.937142:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787847374.937538:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616363392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847375.319855:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847376.344802:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847376.563181:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1787847377.367176:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847377.841914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847377.841983:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847377.842024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847377.842138:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356288 00000100:00100000:1.0:1787847377.842148:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356288 00000100:00100000:1.0:1787847377.842234:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:1.0:1787847377.842245:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356288:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847377.842320:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356288:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847377.842327:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00080000:1.0:1787847377.842347:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847377.843477:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847377.843607:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356032 00000100:00100000:3.0:1787847377.843614:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356032 00000100:00100000:3.0:1787847377.843668:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 275 00000100:00100000:3.0:1787847377.843686:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595356032:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847377.843737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595356032:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 61us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847377.843745:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 275 00000100:00100000:0.0:1787847377.861389:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356160 00000100:00100000:0.0:1787847377.861408:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356160 00000100:00100000:0.0:1787847377.861580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356416 00000100:00100000:0.0:1787847377.861584:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356416 00000100:00100000:0.0:1787847377.861614:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 107 00000100:00100000:0.0:1787847377.861624:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356160:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847377.861717:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356160:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 95us (19693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847377.861725:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 107 00000100:00080000:2.0:1787847377.862706:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847377.863994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 108 00000100:00100000:3.0:1787847377.864017:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595356416:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847377.864094:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595356416:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 87us (20622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847377.864102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 108 00000100:00100000:1.0:1787847378.007578:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616363520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847378.007654:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847378.007871:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363520 00000100:00100000:2.0:1787847378.007880:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363520 00000100:00100000:2.0:1787847378.007978:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787847378.007988:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616363520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847378.008025:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847378.008075:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616363520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847378.008096:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1787847378.008147:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bd9680 x1874693616363520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847378.008166:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616363520:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787847378.008468:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787847378.391163:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847379.415528:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847379.543874:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616363904:0@lo:400:kworker.0 00000100:00100000:0.0:1787847379.543983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847379.544053:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787847379.544060:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f37c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616363776:0@lo:400:kworker.0 00000100:00100000:0.0:1787847379.544084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847379.544099:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616364288:0@lo:400:kworker.0 00000100:00100000:0.0:1787847379.544122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847379.544374:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616364032:0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847379.544437:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787847379.544443:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f35e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616363648:0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544470:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847379.544497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363648 00000100:00100000:1.0:1787847379.544505:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363648 00000100:00100000:1.0:1787847379.544549:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787847379.544566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616363648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616363648:12345-0@lo:400:kworker.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847379.544618:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787847379.544671:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f35e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616363648:0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544678:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616364160:0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847379.544758:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363904 00000100:00100000:1.0:1787847379.544762:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363904 00000100:00080000:1.0:1787847379.544781:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847379.544810:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616363776 00000100:00100000:1.0:1787847379.544813:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616363776 00000100:00100000:1.0:1787847379.544824:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364160 00000100:00100000:1.0:1787847379.544826:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364160 00000100:00080000:1.0:1787847379.544838:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847379.544851:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787847379.544857:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616363904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544895:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616363904:12345-0@lo:400:kworker.0 Request processed in 38us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847379.544901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787847379.544929:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f34b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616363904:0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.544974:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787847379.544980:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616363776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.545012:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616363776:12345-0@lo:400:kworker.0 Request processed in 32us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847379.545018:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787847379.545051:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f37c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616363776:0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.545068:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787847379.545074:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616364160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847379.545125:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616364160:12345-0@lo:400:kworker.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847379.545131:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787847379.545173:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616364160:0@lo:400:kworker.0 00000100:00100000:3.0:1787847379.545384:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364288 00000100:00100000:3.0:1787847379.545389:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364288 00000100:00100000:3.0:1787847379.545436:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364032 00000100:00100000:3.0:1787847379.545439:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364032 00000100:00100000:3.0:1787847379.545457:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787847379.545464:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616364288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847379.545507:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616364288:12345-0@lo:400:kworker.0 Request processed in 44us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847379.545512:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787847379.545525:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787847379.545540:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616364032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847379.545576:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616364032:12345-0@lo:400:kworker.0 Request processed in 36us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847379.545581:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787847379.545621:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787847379.545626:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87efbc4000, transno 4294967300 00000100:00100000:3.0:1787847379.545639:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f36940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616364288:0@lo:400:kworker.0 00000100:00080000:1.0:1787847379.546518:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787847379.546553:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87e6f370c0 x1874693616364032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847379.546565:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616364032:0@lo:400:kworker.0 00000100:00100000:0.0:1787847380.057265:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847380.057296:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616364416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847380.057379:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847380.059147:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364416 00000100:00100000:2.0:1787847380.059161:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364416 00000100:00100000:2.0:1787847380.059224:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787847380.059235:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616364416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847380.059273:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847380.059352:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616364416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847380.059358:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787847380.061631:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ced680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616364416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787847380.439202:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847381.470465:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847382.489719:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847382.961169:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847382.961215:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847382.961246:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847382.961293:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847382.961444:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356672 00000100:00100000:2.0:1787847382.961454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356672 00000100:00100000:2.0:1787847382.961520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356928 00000100:00100000:2.0:1787847382.961524:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356928 00000100:00100000:2.0:1787847382.961555:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:2.0:1787847382.961563:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356672:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847382.961621:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356672:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 60us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847382.961626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:2.0:1787847382.961638:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:2.0:1787847382.961642:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595356928:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847382.961655:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595356928:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 13us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847382.961684:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00080000:0.0:1787847382.962869:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847382.963011:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356544 00000100:00100000:1.0:1787847382.963020:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356544 00000100:00100000:1.0:1787847382.963177:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 277 00000100:00100000:1.0:1787847382.963188:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595356544:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847382.963264:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c87d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595356544:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 77us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847382.963271:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 277 00000100:00100000:3.0:1787847382.963517:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595356800 00000100:00100000:3.0:1787847382.963522:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595356800 00000100:00100000:3.0:1787847382.963624:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:3.0:1787847382.963633:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356800:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847382.963670:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595356800:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 39us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847382.963687:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00080000:2.0:1787847382.964523:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787847383.127240:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616364544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847383.127319:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847383.128284:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364544 00000100:00100000:2.0:1787847383.128294:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364544 00000100:00100000:2.0:1787847383.128405:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787847383.128416:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616364544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847383.128454:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847383.128522:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ced680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616364544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847383.128530:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787847383.128646:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87c7bd9680 x1874693616364544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847383.128681:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616364544:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787847383.129436:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787847383.384276:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787847383.514744:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847384.536142:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847384.664838:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616364672:0@lo:400:kworker.0 00000100:00100000:0.0:1787847384.664916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847384.665059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364672 00000100:00100000:1.0:1787847384.665066:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364672 00000100:00100000:1.0:1787847384.665117:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787847384.665125:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616364672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.667797:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800526940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616364928:0@lo:400:kworker.0 00000100:00100000:1.0:1787847384.667862:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616364672:12345-0@lo:400:kworker.0 Request processed in 2734us (2943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847384.667874:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1787847384.668111:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616364800:0@lo:400:kworker.0 00000100:00100000:0.0:1787847384.668180:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bd9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616364672:0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.668193:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847384.668207:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800527840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616365184:0@lo:400:kworker.0 00000100:00100000:0.0:1787847384.668240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847384.668251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364928 00000100:00100000:3.0:1787847384.668258:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364928 00000100:00100000:0.0:1787847384.668264:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847384.668272:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800526d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616365056:0@lo:400:kworker.0 00000100:00100000:0.0:1787847384.668301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847384.668314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365184 00000100:00100000:3.0:1787847384.668319:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365184 00000100:00100000:3.0:1787847384.668348:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787847384.668357:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365056 00000100:00100000:0.0:1787847384.668362:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365056 00000100:00100000:3.0:1787847384.668371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616364928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847384.668393:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787847384.668403:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616365056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.668427:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616364928:12345-0@lo:400:kworker.0 Request processed in 58us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847384.668446:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616365056:12345-0@lo:400:kworker.0 Request processed in 43us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847384.668452:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787847384.668457:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787847384.668476:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787847384.668484:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616365184:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787847384.668489:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787847384.668523:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800526d00 x1874693616365056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847384.668524:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616365184:12345-0@lo:400:kworker.0 Request processed in 41us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847384.668542:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787847384.668546:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800526d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616365056:0@lo:400:kworker.0 00000100:00100000:0.0:1787847384.668561:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800527840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616365184:0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.668579:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800526940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616364928:0@lo:400:kworker.0 00000100:00100000:2.0:1787847384.668906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847384.668996:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616365312:0@lo:400:kworker.0 00000100:00100000:2.0:1787847384.669020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847384.669098:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616364800 00000100:00100000:0.0:1787847384.669102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616364800 00000100:00100000:0.0:1787847384.669168:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787847384.669176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800526580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616364800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.669192:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365312 00000100:00100000:3.0:1787847384.669198:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365312 00000100:00100000:0.0:1787847384.669226:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800526580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616364800:12345-0@lo:400:kworker.0 Request processed in 50us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847384.669234:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787847384.669241:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787847384.669250:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616365312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.669293:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616365312:12345-0@lo:400:kworker.0 Request processed in 44us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847384.669296:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616364800:0@lo:400:kworker.0 00000100:00100000:3.0:1787847384.669307:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787847384.669315:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616365312:0@lo:400:kworker.0 00000100:00080000:3.0:1787847384.669331:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847385.175213:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616365440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847385.175283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847385.176434:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365440 00000100:00100000:3.0:1787847385.176445:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365440 00000100:00100000:3.0:1787847385.176510:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787847385.176521:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616365440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847385.176556:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847385.176625:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616365440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847385.176632:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787847385.177853:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616365440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787847385.559234:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847386.590363:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847387.609025:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847388.081316:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847388.081368:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847388.081468:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357056 00000100:00100000:1.0:1787847388.081480:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357056 00000100:00100000:1.0:1787847388.081541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 279 00000100:00100000:1.0:1787847388.081552:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595357056:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847388.081648:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595357056:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 99us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847388.081656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 279 00000100:00100000:0.0:1787847388.081754:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357184 00000100:00100000:0.0:1787847388.081759:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357184 00000100:00100000:0.0:1787847388.081812:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:0.0:1787847388.081820:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595357184:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847388.081854:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595357184:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847388.081861:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00080000:1.0:1787847388.081969:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847388.098816:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847388.098901:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847388.099064:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357440 00000100:00100000:2.0:1787847388.099082:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357440 00000100:00100000:2.0:1787847388.099195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:2.0:1787847388.099206:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595357440:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847388.099297:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595357440:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 92us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847388.099305:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:0.0:1787847388.099399:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357312 00000100:00100000:0.0:1787847388.099405:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357312 00000100:00100000:0.0:1787847388.099442:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:0.0:1787847388.099466:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2343:x1874693595357312:12345-192.168.201.21@tcp:9:kworker.0 00000020:00000080:0.0:1787847388.099509:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861d1d 00000100:00080000:0.0:1787847388.099519:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8d8800367800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787847388.099560:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1787847388.100050:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787847388.100057:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847388.100388:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+2:2343:x1874693595357312:12345-192.168.201.21@tcp:9:kworker.0 Request processed in 935us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847388.100396:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00010000:00010000:3.0:1787847388.104772:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847388.248397:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616365568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787847388.248556:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847388.249282:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365568 00000100:00100000:3.0:1787847388.249294:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365568 00000100:00080000:1.0:1787847388.249479:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847388.249521:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787847388.249536:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616365568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847388.249595:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847388.249859:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616365568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 327us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847388.250035:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787847388.250285:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800527480 x1874693616365568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847388.250317:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616365568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787847388.631709:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847389.655333:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847389.783567:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88008552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616366080:0@lo:400:kworker.0 00000100:00100000:2.0:1787847389.783634:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800855680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616365824:0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.783642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847389.783679:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847389.783712:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787847389.783715:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800856d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616366336:0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.783722:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800854f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616365696:0@lo:400:kworker.0 00000100:00100000:2.0:1787847389.783749:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847389.783762:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847389.783782:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847389.783790:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616365952:0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.783795:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800856940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616366208:0@lo:400:kworker.0 00000100:00100000:2.0:1787847389.783823:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847389.783845:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366080 00000100:00100000:0.0:1787847389.783853:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366080 00000100:00100000:2.0:1787847389.783871:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365824 00000100:00100000:2.0:1787847389.783877:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365824 00000100:00100000:0.0:1787847389.783898:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366336 00000100:00100000:0.0:1787847389.783902:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366336 00000100:00100000:2.0:1787847389.783912:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365952 00000100:00100000:2.0:1787847389.783916:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365952 00000100:00100000:0.0:1787847389.783958:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787847389.783969:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616366080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847389.783972:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787847389.783985:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800525e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616365824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.784021:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616366080:12345-0@lo:400:kworker.0 Request processed in 55us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847389.784039:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787847389.784056:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787847389.784062:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616366336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.784095:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616366336:12345-0@lo:400:kworker.0 Request processed in 34us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847389.784101:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787847389.784140:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800856d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616366336:0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.784164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787847389.784183:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d88008552c0 x1874693616366080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847389.784192:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88008552c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616366080:0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.784220:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366208 00000100:00100000:0.0:1787847389.784223:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366208 00000100:00100000:0.0:1787847389.784243:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787847389.784249:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616365952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.784285:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616365952:12345-0@lo:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847389.784291:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787847389.784309:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787847389.784314:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800525e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616365824:12345-0@lo:400:kworker.0 Request processed in 328us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847389.784321:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800856d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616366208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847389.784327:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787847389.784359:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800856d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616366208:12345-0@lo:400:kworker.0 Request processed in 41us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847389.784365:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787847389.784398:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616365952:0@lo:400:kworker.0 00000100:00100000:0.0:1787847389.784417:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800855680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616365824:0@lo:400:kworker.0 00000100:00080000:1.0:1787847389.784423:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787847389.784430:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847389.784443:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800856940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616366208:0@lo:400:kworker.0 00000100:00100000:1.0:1787847389.784445:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616365696 00000100:00100000:1.0:1787847389.784451:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616365696 00000100:00100000:1.0:1787847389.784481:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787847389.784489:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616365696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847389.784543:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616365696:12345-0@lo:400:kworker.0 Request processed in 55us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847389.784550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787847389.786152:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800854f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616365696:0@lo:400:kworker.0 00000100:00100000:0.0:1787847390.295375:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616366464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847390.295468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847390.295680:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366464 00000100:00100000:3.0:1787847390.295688:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366464 00000100:00100000:3.0:1787847390.295846:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787847390.295857:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616366464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847390.295906:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847390.296252:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616366464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 396us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847390.296268:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787847390.296358:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cefc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616366464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847390.682421:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847391.704081:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787847391.936337:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:0.0:1787847391.936348:0:7632:0:(genops.c:885:class_export_put()) final put ffff8d87ef5da800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:0.0:1787847391.936374:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ef5da800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 for lustre-OST0001 00000020:00000080:0.0:1787847391.936423:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d8800367800 for lustre-OST0001 00010000:00010000:1.0:1787847392.727965:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847393.200213:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847393.200292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847393.200325:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847393.200361:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357568 00000100:00100000:3.0:1787847393.200371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357568 00000100:00100000:3.0:1787847393.200422:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 281 00000100:00100000:3.0:1787847393.200432:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595357568:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847393.200513:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595357568:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 81us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847393.200519:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 281 00000100:00100000:0.0:1787847393.202223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357696 00000100:00100000:0.0:1787847393.202234:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357696 00000100:00100000:3.0:1787847393.202281:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357824 00000100:00100000:3.0:1787847393.202285:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357824 00000100:00100000:3.0:1787847393.202375:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:3.0:1787847393.202386:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2346:x1874693595357824:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847393.202455:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2346:x1874693595357824:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 71us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847393.202463:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00080000:1.0:1787847393.202895:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847393.203245:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:3.0:1787847393.203254:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800525a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595357696:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847393.203303:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800525a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595357696:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 50us (3100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847393.203309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:1.0:1787847393.372146:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787847393.372174:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800525680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616366592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847393.372260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847393.374069:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366592 00000100:00100000:2.0:1787847393.374086:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366592 00000100:00100000:2.0:1787847393.374188:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787847393.374200:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616366592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847393.374241:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847393.374340:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cefc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616366592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847393.374349:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1787847393.374569:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800525680 x1874693616366592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847393.374592:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800525680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616366592:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787847393.374679:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787847393.623594:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787847393.751465:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787847394.551430:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 12:16:33 (1787847393) 00010000:00010000:1.0:1787847394.779804:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847394.903436:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616366976:0@lo:400:kworker.0 00000100:00100000:3.0:1787847394.903439:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616366848:0@lo:400:kworker.0 00000100:00100000:2.0:1787847394.903439:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616367104:0@lo:400:kworker.0 00000100:00100000:0.0:1787847394.903747:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616366720:0@lo:400:kworker.0 00000100:00100000:1.0:1787847394.908502:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847394.908615:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366976 00000100:00100000:1.0:1787847394.908623:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366976 00000100:00100000:1.0:1787847394.908690:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787847394.908702:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616366976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847394.908771:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616366976:12345-0@lo:400:kworker.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847394.908779:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1787847394.908801:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847394.908839:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616366976:0@lo:400:kworker.0 00000100:00100000:2.0:1787847394.909860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847394.909985:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616367104 00000100:00100000:1.0:1787847394.910000:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616367104 00000100:00100000:1.0:1787847394.910059:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787847394.910069:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616367104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847394.910128:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616367104:12345-0@lo:400:kworker.0 Request processed in 60us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847394.910134:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1787847394.911921:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d87f9cee940 x1874693616367104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787847410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847394.911965:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616367104:0@lo:400:kworker.0 00000100:00100000:3.0:1787847394.913541:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847394.913542:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847394.913675:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366848 00000100:00100000:2.0:1787847394.913684:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366848 00000100:00100000:2.0:1787847394.913730:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787847394.913738:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616366848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847394.913827:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616366848:12345-0@lo:400:kworker.0 Request processed in 90us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847394.913834:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787847394.913924:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616366848:0@lo:400:kworker.0 00000100:00100000:3.0:1787847394.913951:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616367360:0@lo:400:kworker.0 00000100:00100000:3.0:1787847394.913982:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847394.914087:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616367360 00000100:00100000:2.0:1787847394.914091:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616367360 00000100:00100000:2.0:1787847394.914159:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787847394.914165:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616367360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847394.914207:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616367360:12345-0@lo:400:kworker.0 Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847394.914213:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787847394.914224:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616367232:0@lo:400:kworker.0 00000100:00100000:0.0:1787847394.914269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847394.914274:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616367360:0@lo:400:kworker.0 00000100:00100000:0.0:1787847394.914325:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616367232 00000100:00100000:0.0:1787847394.914330:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616367232 00000100:00080000:3.0:1787847394.914713:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847394.914719:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847394.915366:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787847394.915388:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616367232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847394.915446:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616367232:12345-0@lo:400:kworker.0 Request processed in 71us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847394.915480:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787847394.915524:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616367232:0@lo:400:kworker.0 00000100:00100000:1.0:1787847394.918341:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616366720 00000100:00100000:1.0:1787847394.918355:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616366720 00000100:00100000:1.0:1787847394.918868:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787847394.918896:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616366720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847394.919023:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616366720:12345-0@lo:400:kworker.0 Request processed in 132us (5490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847394.919030:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1787847394.919116:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616366720:0@lo:400:kworker.0 00000100:00100000:2.0:1787847395.415232:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616367488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847395.415307:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847395.415493:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616367488 00000100:00100000:0.0:1787847395.415502:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616367488 00000100:00100000:0.0:1787847395.415561:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787847395.415572:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616367488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847395.415609:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847395.415668:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616367488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847395.415677:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787847395.415765:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616367488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787847395.801101:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847396.239013:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847396.239402:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595357952 00000100:00100000:2.0:1787847396.239412:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595357952 00000100:00100000:2.0:1787847396.239510:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:2.0:1787847396.239523:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:10203:x1874693595357952:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847396.239543:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847396.239580:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c23 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.239647:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861def lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.239663:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.239676:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847396.239867:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787847396.239871:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847396.240011:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861def lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.240040:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c23 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.240058:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861def lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c23 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.240067:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:2.0:1787847396.240070:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847396.240074:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847396.240153:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:10203:x1874693595357952:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 632us (1148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847396.240159:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00080000:3.0:1787847396.241877:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847396.246888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847396.247037:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358080 00000100:00100000:0.0:1787847396.247048:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358080 00000100:00100000:0.0:1787847396.247113:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:0.0:1787847396.247124:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800525680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:10204:x1874693595358080:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847396.247155:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847396.247181:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9861df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c2a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.247250:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.247264:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.247285:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.247299:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.247306:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.247312:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248030:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff600/0x1835de88b9861e0b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248045:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff600/0x1835de88b9861e0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248054:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff600/0x1835de88b9861e0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847396.248687:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787847396.248694:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847396.248786:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff600/0x1835de88b9861e0b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248798:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248805:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248820:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248826:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847396.248829:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248836:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248848:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:0.0:1787847396.248852:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847396.248856:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248862:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9861dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248872:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248877:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248882:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248887:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847396.248890:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248902:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248908:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d87c7207d00) 00010000:00010000:0.0:1787847396.248910:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847396.248913:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248917:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9861e04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.248996:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9861df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c2a expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.249009:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff600/0x1835de88b9861e0b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c2a expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847396.249015:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d87c7207000) 00010000:00010000:0.0:1787847396.249016:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787847396.249018:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff600, rc 0) 00000100:00100000:0.0:1787847396.249087:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800525680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:10204:x1874693595358080:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1965us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847396.249095:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:1.0:1787847396.257663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847396.257768:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358336 00000100:00100000:2.0:1787847396.257780:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358336 00000100:00100000:2.0:1787847396.257852:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1787847396.257864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:10204:x1874693595358336:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847396.257890:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847396.257912:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c31 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258040:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258057:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258070:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258125:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258253:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258265:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258838:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861e27 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861e27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.258866:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861e27 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847396.258878:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787847396.262801:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262818:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262825:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262831:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847396.262836:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262844:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262863:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d87c7207000) 00010000:00010000:2.0:1787847396.262866:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847396.262871:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262877:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861e19 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262891:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262896:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262912:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262917:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847396.262919:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.262924:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.263212:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d87c4d7f300) 00010000:00010000:2.0:1787847396.263216:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847396.263221:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.263228:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e20 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.263735:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c31 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.263752:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861e27 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c31 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847396.263760:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:2.0:1787847396.263762:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847396.263765:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a800, rc 0) 00000100:00100000:2.0:1787847396.265908:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:10204:x1874693595358336:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 8032us (8244us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787847396.265973:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1787847396.278045:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847396.278165:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358464 00000100:00100000:1.0:1787847396.278175:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358464 00000100:00100000:1.0:1787847396.278226:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:1.0:1787847396.278236:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:10204:x1874693595358464:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787847396.278347:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:10204:x1874693595358464:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 Request processed in 111us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847396.278355:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000040:00080000:1.0:1787847396.695908:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787847396.825812:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847397.041908:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1787847397.852188:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847398.322114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.322183:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847398.322273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358720 00000100:00100000:3.0:1787847398.322287:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358720 00000100:00100000:3.0:1787847398.322375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:3.0:1787847398.322388:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595358720:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847398.322503:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595358720:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 119us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847398.322511:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:3.0:1787847398.322539:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358592 00000100:00100000:3.0:1787847398.322543:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358592 00000100:00100000:3.0:1787847398.322568:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 283 00000100:00100000:3.0:1787847398.322575:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595358592:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847398.322601:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595358592:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847398.322607:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 283 00000100:00080000:1.0:1787847398.323025:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847398.325481:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847398.325569:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358848 00000100:00100000:0.0:1787847398.325582:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358848 00000100:00100000:0.0:1787847398.325661:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00100000:0.0:1787847398.325672:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2346:x1874693595358848:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847398.325781:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2346:x1874693595358848:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847398.325788:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00080000:3.0:1787847398.326293:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847398.488209:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847398.488242:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800856580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616367616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847398.488341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847398.489067:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616367616 00000100:00100000:0.0:1787847398.489079:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616367616 00000100:00100000:3.0:1787847398.489294:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787847398.489308:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616367616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847398.489355:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847398.489438:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616367616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1097us total) trans 0 rc 0/0 00000100:00080000:1.0:1787847398.489443:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847398.489447:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1787847398.489499:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800856580 x1874693616367616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847398.489527:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800856580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616367616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847398.511122:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847398.514438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595358976 00000100:00100000:0.0:1787847398.514458:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595358976 00000100:00100000:1.0:1787847398.514607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1787847398.514620:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800526940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:10247:x1874693595358976:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847398.514647:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847398.514675:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9861e35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c38 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.514756:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.514773:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.514789:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.514806:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.514824:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.514830:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515339:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515349:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515362:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515368:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847398.515373:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515381:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515395:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:1.0:1787847398.515398:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847398.515413:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515421:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861e3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515433:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515438:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515443:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515447:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847398.515450:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515464:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515471:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d87e122ea00) 00010000:00010000:1.0:1787847398.515473:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847398.515476:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515481:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9861e43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515519:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9861e35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c38 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515531:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:1.0:1787847398.515533:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847398.515536:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9861e35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c38 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.515544:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4200, rc 0) 00000100:00100000:1.0:1787847398.515674:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800526940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:10247:x1874693595358976:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1056us (4569us total) trans 0 rc 301/301 00000100:00100000:1.0:1787847398.515682:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:0.0:1787847398.522820:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.523001:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595359232 00000100:00100000:1.0:1787847398.523017:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595359232 00000100:00100000:1.0:1787847398.523097:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:1.0:1787847398.523111:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:10247:x1874693595359232:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:1.0:1787847398.523206:0:7214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847398.523245:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861def lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c23 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.523271:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f500) 00010000:00010000:1.0:1787847398.523286:0:7214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787847398.523641:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.523679:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.523690:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.523704:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.523711:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.523716:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847398.526764:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787847398.526789:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.526800:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.526819:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.526837:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5c00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847398.526842:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.526851:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.526880:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87e122ed00) 00010000:00010000:1.0:1787847398.526883:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847398.526889:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.526894:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9861e4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787847398.526921:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b2de279b reply state 00000000893a9912 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847398.526951:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787847398.527121:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:10247:x1874693595359232:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 4007us (4322us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787847398.527132:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00010000:00010000:1.0:1787847398.531642:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.531665:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.531674:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.531707:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847398.531713:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.531721:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.531744:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d87e122eb00) 00010000:00010000:1.0:1787847398.531748:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847398.531753:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.531758:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9861e51 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847398.701131:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847398.701232:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595359360 00000100:00100000:3.0:1787847398.701265:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595359360 00000100:00100000:3.0:1787847398.701352:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1787847398.701364:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:10255:x1874693595359360:12345-192.168.201.21@tcp:101:lctl.0 00010000:00010000:3.0:1787847398.701407:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847398.701439:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c3f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847398.701535:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861e5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847398.701552:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861e5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847398.701567:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861e5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847398.701649:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787847398.701654:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847398.701705:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861e5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847398.701735:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c3f expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847398.701755:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861e5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c3f expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847398.701764:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847398.701767:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847398.701771:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847398.701850:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:10255:x1874693595359360:12345-192.168.201.21@tcp:101:lctl.0 Request processed in 490us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847398.702002:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1787847398.773640:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847398.773785:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595359488 00000100:00100000:0.0:1787847398.773797:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595359488 00000100:00100000:0.0:1787847398.773913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1787847398.773928:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:10261:x1874693595359488:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847398.774004:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847398.774041:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c46 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774135:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774154:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774167:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774184:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774191:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774220:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774378:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774385:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774404:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847398.774445:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787847398.774449:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847398.774505:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774524:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774532:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774543:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774550:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847398.774555:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774563:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774584:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847398.774587:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847398.774593:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774600:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861e6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774621:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774627:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774633:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774638:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847398.774644:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774650:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774656:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d87c7207100) 00010000:00010000:0.0:1787847398.774658:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847398.774660:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774666:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861e74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c46 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774730:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c46 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.774738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847398.774740:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787847398.774742:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe200, rc 0) 00000100:00100000:0.0:1787847398.774810:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:10261:x1874693595359488:12345-192.168.201.21@tcp:101:bash.0 Request processed in 888us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847398.774818:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:3.0:1787847398.779353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847398.779466:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595359744 00000100:00100000:2.0:1787847398.779479:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595359744 00000100:00100000:2.0:1787847398.779558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:2.0:1787847398.779569:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:10261:x1874693595359744:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1787847398.779598:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847398.779628:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861e82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c4d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.780230:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.780249:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.780262:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.784219:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.784247:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.784262:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787847398.785349:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787847398.789051:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789075:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789089:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789131:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789139:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789146:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789153:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847398.789158:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789166:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789179:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847398.789182:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847398.789187:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789212:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861e89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847398.789230:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8042382 reply state 000000004d2d68fe transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847398.789239:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787847398.789280:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861e82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789296:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.789304:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:2.0:1787847398.789306:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847398.789309:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:2.0:1787847398.789765:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10261:x1874693595359744:12345-192.168.201.21@tcp:101:bash.0 Request processed in 10195us (10423us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787847398.789776:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00010000:00010000:0.0:1787847398.792519:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.792542:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.792551:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.792557:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847398.792563:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.792573:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.792596:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7fe00) 00010000:00010000:0.0:1787847398.792621:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847398.792629:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.792638:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9861e90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847398.812711:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.812989:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595359872 00000100:00100000:1.0:1787847398.813003:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595359872 00000100:00100000:1.0:1787847398.813062:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:1.0:1787847398.813072:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1874693595359872:12345-192.168.201.21@tcp:8:bash.0 00010000:00080000:1.0:1787847398.813117:0:6679:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:1.0:1787847398.813168:0:6679:0:(genops.c:1385:class_connect()) connect: client 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3, cookie 0x1835de88b9861ea5 00002000:00100000:1.0:1787847398.813184:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3/ffff8d87ef4be000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787847398.813198:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787847398.813506:0:6679:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787847398.813546:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d87ef4be800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847398.813634:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2343:x1874693595359872:12345-192.168.201.21@tcp:8:bash.0 Request processed in 561us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847398.813664:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:2.0:1787847398.818390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.818515:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595360000 00000100:00100000:1.0:1787847398.818528:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595360000 00000100:00100000:1.0:1787847398.818627:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1787847398.818641:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800526d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:0:x1874693595360000:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1787847398.818667:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847398.818697:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c54 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847398.818732:0:7920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847398.818759:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1787847398.818764:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847398.818776:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 7 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.818801:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 7 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.818832:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5a00, rc 0) 00000100:00100000:1.0:1787847398.818910:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800526d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:0:x1874693595360000:12345-192.168.201.21@tcp:101:bash.0 Request processed in 273us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847398.818918:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00080000:3.0:1787847398.819406:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847398.833029:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.833105:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595360128 00000100:00100000:1.0:1787847398.833119:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595360128 00000100:00100000:1.0:1787847398.833235:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:1.0:1787847398.833248:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:10261:x1874693595360128:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1787847398.833294:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847398.833321:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c5b expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.833364:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.833376:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847398.833381:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847398.833387:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.833439:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.833455:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847398.833473:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9cecb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874693616367744:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847398.833601:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847398.839747:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9cecb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874693616367744:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847398.839874:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847398.839919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:1.0:1787847398.840307:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5c00, rc 0) 00000100:00100000:1.0:1787847398.840411:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:10261:x1874693595360128:12345-192.168.201.21@tcp:101:bash.0 Request processed in 7153us (7387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847398.840422:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:2.0:1787847398.842001:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595360256 00000100:00100000:2.0:1787847398.842020:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595360256 00010000:00010000:2.0:1787847398.842086:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847398.842178:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:2.0:1787847398.842187:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595360256:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847398.842217:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847398.842243:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.842254:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.842280:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9861eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c54 expref: 8 pid: 7920 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.842298:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847398.842302:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847398.842310:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.842318:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.842356:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847398.842369:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005270c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1874693616367872:192.168.201.21@tcp:105: 00000100:00100000:2.0:1787847398.842491:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847398.845674:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005270c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1874693616367872:192.168.201.21@tcp:105: 00010000:00010000:2.0:1787847398.845710:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847398.845852:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595360256:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3664us (5932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847398.845867:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:3.0:1787847398.848363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847398.848619:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595360512 00000100:00100000:0.0:1787847398.848633:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595360512 00000100:00100000:0.0:1787847398.848739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:0.0:1787847398.848751:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:10261:x1874693595360512:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:0.0:1787847398.849249:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10261:x1874693595360512:12345-192.168.201.21@tcp:35:bash.0 Request processed in 498us (901us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787847398.849258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00010000:00010000:2.0:1787847398.876067:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847398.900519:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847398.900665:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595360768 00000100:00100000:0.0:1787847398.900678:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595360768 00000100:00100000:0.0:1787847398.900809:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:0.0:1787847398.900821:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10271:x1874693595360768:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847398.900864:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847398.900893:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c62 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847398.901103:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787847398.901337:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861eba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c62 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.901356:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847398.901360:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847398.901367:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c62 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.901386:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afea00, rc 0) 00000100:00100000:2.0:1787847398.901477:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10271:x1874693595360768:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 659us (973us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787847398.901486:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:1.0:1787847398.905090:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847398.905151:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595361024 00000100:00100000:3.0:1787847398.905164:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595361024 00000100:00100000:3.0:1787847398.905287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847398.905302:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10271:x1874693595361024:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847398.905649:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10271:x1874693595361024:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 350us (574us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787847398.905657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847398.963216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847398.963441:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595361152 00000100:00100000:2.0:1787847398.963453:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595361152 00000100:00100000:2.0:1787847398.963524:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:2.0:1787847398.963534:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10277:x1874693595361152:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847398.963565:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847398.963589:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861ec8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c69 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.963671:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.963687:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.963717:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847398.964131:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787847398.964136:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847398.964169:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.964201:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861ec8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c69 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.964222:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c69 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.964231:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847398.964234:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847398.964237:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152aa00, rc 0) 00000100:00100000:2.0:1787847398.964310:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:10277:x1874693595361152:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 778us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847398.964318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:2.0:1787847398.968468:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.969069:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595361408 00000100:00100000:1.0:1787847398.969083:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595361408 00000100:00100000:1.0:1787847398.969149:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1787847398.969162:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:10277:x1874693595361408:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847398.969191:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847398.969215:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861ed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c70 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.969326:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9861edd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.969339:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9861edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.969349:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9861edd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847398.969359:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787847398.969529:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9861ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c70 expref: 19 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.969549:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9861edd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c70 expref: 18 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.969557:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:1.0:1787847398.969575:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787847398.969579:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4a00, rc 0) 00000100:00100000:1.0:1787847398.969702:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:10277:x1874693595361408:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 543us (1248us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787847398.969710:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1787847398.974321:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.974414:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847398.974553:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595361664 00000100:00100000:2.0:1787847398.974566:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595361664 00000100:00100000:2.0:1787847398.974644:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:2.0:1787847398.974656:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:10277:x1874693595361664:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847398.974692:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847398.974721:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861eeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c77 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.974882:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861ef2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.974900:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.974914:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861ef2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847398.974928:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787847398.975223:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c77 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.975242:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c77 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.975252:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:2.0:1787847398.975256:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787847398.975260:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847398.975427:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10277:x1874693595361664:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 773us (1011us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787847398.975437:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:0.0:1787847398.975578:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595361792 00000100:00100000:0.0:1787847398.975585:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595361792 00000100:00100000:0.0:1787847398.975632:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:0.0:1787847398.975640:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9cee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:2344:x1874693595361792:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847398.975660:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847398.975676:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9861edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c70 expref: 20 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847398.975688:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:0.0:1787847398.975691:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847398.975709:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9cee940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:2344:x1874693595361792:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 71us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847398.975715:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:3.0:1787847398.981386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847398.981629:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595361920 00000100:00100000:1.0:1787847398.981643:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595361920 00000100:00100000:1.0:1787847398.981746:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:1.0:1787847398.981758:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595361920:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:1.0:1787847398.981823:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.981848:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.981865:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847398.981870:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847398.981876:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.981970:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847398.981988:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847398.982021:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7920:1874693616368000:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847398.982141:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847398.984784:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f370c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7920:1874693616368000:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847398.984831:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847398.987500:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847398.987740:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595362048 00000100:00100000:2.0:1787847398.987765:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595362048 00002000:00100000:2.0:1787847398.987821:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d87e6e0e940 x1874693595362048/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:614/0 lens 504/0 e 0 to 0 dl 1787847409 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847398.987833:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6e0e940 with x1874693595362048 ext(0->12) 00010000:00010000:2.0:1787847398.987843:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 8 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847398.987864:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 8 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787847398.987874:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87e6e0e940 00000100:00100000:2.0:1787847398.988011:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1787847398.988022:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595362048:12345-192.168.201.21@tcp:4:lfs.0 00000001:00100000:1.0:1787847399.019735:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000100:00100000:3.0:1787847399.054796:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2347:x1874693595362048:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 66764us (67295us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787847399.055331:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00002000:00100000:3.0:1787847399.055345:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d87e6e0e940 x1874693595362048/t4294967299(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:614/0 lens 504/448 e 0 to 0 dl 1787847409 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787847399.055356:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6e0e940 with x1874693595362048 ext(0->12) 00010000:00010000:3.0:1787847399.055377:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 9 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.055415:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 9 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847399.055425:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87e6e0e940 00000001:00080000:2.0:1787847399.055621:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1787847399.062837:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.063200:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595362176 00000100:00100000:3.0:1787847399.063210:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595362176 00010000:00010000:3.0:1787847399.063248:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.063316:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:3.0:1787847399.063325:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595362176:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847399.063339:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787847399.063358:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787847399.063361:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787847399 00002000:00010000:3.0:1787847399.063372:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787847399 00002000:00010000:3.0:1787847399.063374:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787847399 00002000:00010000:3.0:1787847399.063376:0:5830:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1787847399.063382:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.063405:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.063432:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9861eb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c5b expref: 7 pid: 6679 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.063470:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847399.063475:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847399.063481:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.063491:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.063521:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847399.063574:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595362176:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 249us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847399.063581:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00010000:00010000:1.0:1787847399.063956:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.063967:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.063991:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.063999:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.064007:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.064014:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847399.064018:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.064026:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.064044:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.064052:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9861f00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847399.064116:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595361920:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 82359us (82740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847399.064123:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:1.0:1787847399.089063:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847399.089249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595362432 00000100:00100000:0.0:1787847399.089261:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595362432 00000100:00100000:0.0:1787847399.089320:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:0.0:1787847399.089329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:10277:x1874693595362432:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:0.0:1787847399.089411:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861ef2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c77 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847399.089704:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787847399.089761:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787847399.093919:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787847399.094041:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.094065:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.094075:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.094200:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.094218:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 23 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847399.094234:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874693616368128:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847399.094409:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f15c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847399.112658:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847399.119264:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595362560 00000100:00100000:1.0:1787847399.119282:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595362560 00010000:00010000:1.0:1787847399.119345:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 24 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847399.119422:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:1.0:1787847399.119432:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:2346:x1874693595362560:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847399.119449:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847399.119456:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 24 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.119470:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 24 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.119493:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:1.0:1787847399.119513:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.119523:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.119531:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.119552:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847399.119620:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:2346:x1874693595362560:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 189us (6972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847399.119627:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00010000:00010000:3.0:1787847399.123020:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c4d expref: 23 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.123046:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874693616368128:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847399.123074:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.123085:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.123092:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787847399.123795:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787847399.124491:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787847399.124606:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616368256:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787847399.124732:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847399.124767:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847399.125087:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616368256 00000100:00100000:1.0:1787847399.125095:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616368256 00000100:00100000:1.0:1787847399.125166:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847399.125176:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616368256:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787847399.125258:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616368256:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847399.125265:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787847399.127215:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616368256:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787847399.129769:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787847399.129864:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616368384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787847399.129965:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847399.130007:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847399.130410:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616368384 00000100:00100000:1.0:1787847399.130418:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616368384 00000100:00100000:1.0:1787847399.130463:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787847399.130472:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616368384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787847399.130704:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1874693616368384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 232us (773us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787847399.130711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847399.132313:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0ed00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616368384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787847399.132542:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787847399.132601:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.132612:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.132620:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.132626:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847399.132631:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.132639:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.132655:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:3.0:1787847399.132658:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787847399.132723:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.132730:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9861f07 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787847399.134741:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787847399.135661:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787847399.136461:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313960527838ns, next at 314960520411ns, rc = 0 00000001:00080000:3.0:1787847399.136478:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787847399.136547:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:3.0:1787847399.136552:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787847399.136563:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861ef2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c77 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.138268:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:10277:x1874693595362432:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 48929us (49204us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787847399.138283:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000020:00080000:3.0:1787847399.138292:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787847399.140905:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.141142:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595362688 00000100:00100000:3.0:1787847399.141154:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595362688 00000100:00100000:3.0:1787847399.141208:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1787847399.141219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:10277:x1874693595362688:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847399.141249:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847399.141274:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861f0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c7e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.141335:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861f0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c7e expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.141377:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861f0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c7e expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.141405:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847399.141408:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847399.141412:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7200, rc 0) 00000100:00100000:3.0:1787847399.141461:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:10277:x1874693595362688:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 244us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847399.141467:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:0.0:1787847399.147434:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.147558:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595362944 00000100:00100000:3.0:1787847399.147568:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595362944 00000100:00100000:3.0:1787847399.147627:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1787847399.147638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e97b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:10277:x1874693595362944:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847399.147897:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e97b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:10277:x1874693595362944:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 261us (472us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1787847399.147906:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:0.0:1787847399.267925:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847399.268070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595363200 00000100:00100000:2.0:1787847399.268082:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595363200 00000100:00100000:2.0:1787847399.268155:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:2.0:1787847399.268165:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800855a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:10287:x1874693595363200:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847399.268190:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847399.268211:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c85 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847399.268338:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787847399.268469:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c85 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.268484:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847399.268500:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847399.268506:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c85 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.268519:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847399.268579:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800855a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:10287:x1874693595363200:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 416us (667us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787847399.268587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1787847399.270977:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.271189:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595363328 00000100:00100000:3.0:1787847399.271201:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595363328 00000100:00100000:3.0:1787847399.271277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:3.0:1787847399.271290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:10287:x1874693595363328:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:3.0:1787847399.271400:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271422:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271460:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271479:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271487:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271494:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271619:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271627:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271634:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847399.271691:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271707:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271714:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271721:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271737:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847399.271742:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271750:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271765:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847399.271768:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847399.271773:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271779:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271807:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271814:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271820:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271825:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847399.271827:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271832:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.271848:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c3361100) 00010000:00010000:3.0:1787847399.271850:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847399.272141:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272149:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272166:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272172:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272177:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272181:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847399.272184:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272190:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272199:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847399.272201:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847399.272204:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.272209:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.272324:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:10287:x1874693595363328:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1035us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847399.272335:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:0.0:1787847399.277409:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.277508:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595363584 00000100:00100000:3.0:1787847399.277524:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595363584 00000100:00100000:3.0:1787847399.277597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1787847399.277610:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800855e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:10287:x1874693595363584:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847399.278011:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800855e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:10287:x1874693595363584:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 402us (627us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787847399.278022:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1787847399.337332:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847399.337487:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595363840 00000100:00100000:2.0:1787847399.337500:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595363840 00000100:00100000:2.0:1787847399.337588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:2.0:1787847399.337600:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800856580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:10290:x1874693595363840:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847399.337633:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847399.337661:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c8c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.337759:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.337777:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.337791:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.337811:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.337818:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.337847:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338055:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338065:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338073:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847399.338084:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787847399.338201:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338209:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338216:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338224:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847399.338228:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338236:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338251:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847399.338255:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847399.338267:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338275:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338290:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338297:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338303:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338309:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847399.338312:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338318:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338326:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7f000) 00010000:00010000:2.0:1787847399.338328:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847399.338331:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338337:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338396:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338427:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.338435:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847399.338438:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847399.338441:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:2.0:1787847399.338526:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800856580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:10290:x1874693595363840:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 928us (1209us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787847399.338534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:1.0:1787847399.341771:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.342156:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595363968 00000100:00100000:3.0:1787847399.342170:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595363968 00000100:00100000:3.0:1787847399.342243:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1787847399.342255:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:10290:x1874693595363968:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1787847399.342347:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342368:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342381:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342424:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342431:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342447:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342453:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847399.342458:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342466:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342489:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847399.342493:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847399.342498:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.342506:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.342609:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:10290:x1874693595363968:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 357us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847399.342617:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:0.0:1787847399.346355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.346468:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595364224 00000100:00100000:3.0:1787847399.346481:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595364224 00000100:00100000:3.0:1787847399.346553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1787847399.346566:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:10290:x1874693595364224:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847399.346899:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:10290:x1874693595364224:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 335us (557us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1787847399.346909:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1787847399.618173:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847399.618280:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595364480 00000100:00100000:2.0:1787847399.618294:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595364480 00000100:00100000:2.0:1787847399.618374:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:2.0:1787847399.618395:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800855680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:10321:x1874693595364480:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1787847399.618430:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847399.618457:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c93 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.618583:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.618600:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.618614:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847399.618625:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787847399.618827:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861f62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c93 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.618849:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c93 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.618858:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847399.618862:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847399.618865:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847399.619002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800855680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10321:x1874693595364480:12345-192.168.201.21@tcp:101:cat.0 Request processed in 618us (844us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787847399.619010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:1.0:1787847399.622064:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847399.622160:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595364608 00000100:00100000:2.0:1787847399.622173:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595364608 00000100:00100000:2.0:1787847399.622255:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:2.0:1787847399.622267:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:2344:x1874693595364608:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847399.622287:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847399.622320:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9861f69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c93 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847399.622343:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847399.622347:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847399.622420:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:2344:x1874693595364608:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 155us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847399.622428:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:0.0:1787847399.624390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.624477:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595364864 00000100:00100000:3.0:1787847399.624489:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595364864 00000100:00100000:3.0:1787847399.624558:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1787847399.624571:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800856940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:10321:x1874693595364864:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:3.0:1787847399.624915:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800856940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10321:x1874693595364864:12345-192.168.201.21@tcp:35:cat.0 Request processed in 338us (538us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787847399.624925:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:0.0:1787847399.680613:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.680702:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595365120 00000100:00100000:3.0:1787847399.680713:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595365120 00000100:00100000:3.0:1787847399.680782:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1787847399.680791:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10327:x1874693595365120:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:3.0:1787847399.680827:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847399.680830:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787847399.680871:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9861ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c69 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.680896:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847399.680902:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847399.680977:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f77 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0c9a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.681100:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.681116:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.681126:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.681190:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.681205:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 35 pid: 5844 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.681218:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0e580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616368512:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847399.681318:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787847399.683683:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0e580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616368512:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847399.683735:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847399.684523:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847399.684588:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595365248 00000100:00100000:1.0:1787847399.684597:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595365248 00010000:00010000:1.0:1787847399.684637:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 36 pid: 5844 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847399.684674:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:1.0:1787847399.684681:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:2346:x1874693595365248:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847399.684695:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847399.684701:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 36 pid: 5844 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.684711:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 36 pid: 5844 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.684734:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9861f4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c8c expref: 36 pid: 5844 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.684749:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:1.0:1787847399.684754:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.684762:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.684768:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.684793:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847399.684867:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:2346:x1874693595365248:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 185us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847399.684875:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00010000:00010000:3.0:1787847399.685097:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.685106:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847399.685129:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787847399.685331:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861f77 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.685344:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.685349:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847399.685352:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847399.685361:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847399.685403:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10327:x1874693595365120:12345-192.168.201.21@tcp:101:dd.0 Request processed in 4613us (4804us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787847399.685411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:1.0:1787847399.689210:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847399.689375:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595365504 00000100:00100000:3.0:1787847399.689399:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595365504 00000100:00100000:3.0:1787847399.689474:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:3.0:1787847399.689485:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10327:x1874693595365504:12345-192.168.201.21@tcp:36:dd.0 00010000:00010000:3.0:1787847399.689876:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.689898:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847399.689913:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787847399.690015:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787847399.690047:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010105a95 reply state 00000000527b1b4e transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.690058:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847399.690172:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:10327:x1874693595365504:12345-192.168.201.21@tcp:36:dd.0 Request processed in 687us (988us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787847399.690181:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000020:00080000:3.0:1787847399.690187:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787847399.703063:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.703090:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.703099:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.703105:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847399.703111:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.703120:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.703143:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:1.0:1787847399.703146:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847399.703153:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847399.703159:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861f8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.895230:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847399.990885:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847399.991160:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595365632 00000100:00100000:0.0:1787847399.991173:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595365632 00000100:00100000:0.0:1787847399.991367:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:0.0:1787847399.991390:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+37:10341:x1874693595365632:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:0.0:1787847399.991426:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847399.991456:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ca1 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991561:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991581:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991596:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991614:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991621:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991628:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991766:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991779:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991789:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991864:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847399.991893:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 38 pid: 5845 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847399.991912:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e00f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616368640:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847399.992079:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f15c9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787847399.998720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847399.999004:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e00f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616368640:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847399.999079:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847399.999306:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595365888 00000100:00100000:3.0:1787847399.999317:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595365888 00000100:00100000:3.0:1787847399.999394:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1787847399.999406:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:5584:x1874693595365888:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787847400.000461:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:5584:x1874693595365888:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 1049us (1749us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787847400.000473:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1787847400.009922:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.010063:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595366016 00000100:00100000:2.0:1787847400.010076:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595366016 00010000:00010000:2.0:1787847400.010167:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 40 pid: 5845 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847400.010220:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:2.0:1787847400.010233:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:2346:x1874693595366016:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847400.010252:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847400.010259:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 40 pid: 5845 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.010274:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 40 pid: 5845 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.010303:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861f7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c9a expref: 40 pid: 5845 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.010324:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847400.010330:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.010341:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.010350:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.010394:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847400.010461:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:2346:x1874693595366016:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 231us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.010469:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00080000:3.0:1787847400.010674:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787847400.011522:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011537:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847400.011598:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787847400.011603:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847400.011657:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011673:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011685:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011691:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011698:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011705:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847400.011722:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011730:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011746:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847400.011750:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847400.011754:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011761:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861f9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011778:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011785:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011801:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011806:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847400.011808:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011813:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011820:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c7207100) 00010000:00010000:0.0:1787847400.011822:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847400.011831:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011836:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9861fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011885:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9861f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca1 expref: 39 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011910:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca1 expref: 38 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.011918:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847400.011921:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847400.011923:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe800, rc 0) 00000100:00100000:0.0:1787847400.012044:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:10341:x1874693595365632:12345-192.168.201.21@tcp:101:stat.0 Request processed in 20666us (21178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847400.012054:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:1.0:1787847400.024321:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616369152:0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024432:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847400.024494:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787847400.024499:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616368768:0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024528:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847400.024556:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616369280:0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024583:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847400.024611:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616369024:0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847400.024652:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787847400.024656:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616368896:0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847400.024705:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616369408:0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847400.024750:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616368768 00000100:00100000:1.0:1787847400.024758:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616368768 00000100:00100000:1.0:1787847400.024809:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787847400.024819:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616368768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.024876:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3302:x1874693616368768:12345-0@lo:400:kworker.0 Request processed in 58us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847400.024885:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787847400.024924:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616369152 00000100:00100000:1.0:1787847400.024928:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616369152 00000100:00100000:1.0:1787847400.025003:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616369408 00000100:00100000:1.0:1787847400.025007:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616369408 00000100:00100000:1.0:1787847400.025030:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787847400.025037:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616369152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847400.025070:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616369152:12345-0@lo:400:kworker.0 Request processed in 34us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847400.025076:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787847400.025201:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787847400.025212:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616369408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025255:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616369408:12345-0@lo:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.025261:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787847400.025308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616369280 00000100:00100000:2.0:1787847400.025312:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616369280 00000100:00100000:2.0:1787847400.025342:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616369024 00000100:00100000:2.0:1787847400.025345:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616369024 00000100:00100000:2.0:1787847400.025358:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616368896 00000100:00100000:2.0:1787847400.025360:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616368896 00000100:00100000:2.0:1787847400.025372:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787847400.025391:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616369280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025421:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616369280:12345-0@lo:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.025427:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787847400.025441:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787847400.025448:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616369024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616369024:12345-0@lo:400:kworker.0 Request processed in 28us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.025481:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787847400.025492:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787847400.025498:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616368896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025525:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616368896:12345-0@lo:400:kworker.0 Request processed in 28us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.025530:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787847400.025573:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616368768:0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025600:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616369280:0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025611:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616369152:0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025672:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616368896:0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025683:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fde580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616369408:0@lo:400:kworker.0 00000100:00100000:2.0:1787847400.025694:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616369024:0@lo:400:kworker.0 00000100:00080000:3.0:1787847400.025809:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847400.025815:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847400.025817:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847400.091060:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.091434:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595366272 00000100:00100000:2.0:1787847400.091452:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595366272 00000100:00100000:2.0:1787847400.091543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:2.0:1787847400.091555:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:10347:x1874693595366272:12345-192.168.201.21@tcp:36:truncate.0 00010000:00010000:2.0:1787847400.091636:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847400.091676:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9861fa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca1 expref: 38 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.091702:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847400.091708:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847400.092074:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.092103:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.092115:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787847400.092173:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787847400.092307:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b09b6343 reply state 00000000112c847a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847400.092333:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847400.092494:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:10347:x1874693595366272:12345-192.168.201.21@tcp:36:truncate.0 Request processed in 939us (1443us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787847400.092503:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000020:00080000:2.0:1787847400.092510:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787847400.094165:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.094184:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.094193:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.094199:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847400.094205:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.094230:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.094262:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847400.094265:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847400.094270:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.094277:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9861faf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847400.366178:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847400.370140:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595366400 00000100:00100000:3.0:1787847400.370159:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595366400 00000100:00100000:3.0:1787847400.370251:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:3.0:1787847400.370262:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:10361:x1874693595366400:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:3.0:1787847400.370290:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847400.370462:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861fb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ca8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370677:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370693:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370708:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370725:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370733:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370760:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370869:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370877:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.370884:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847400.370921:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787847400.370926:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847400.372473:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372506:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372519:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372527:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372535:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372542:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847400.372547:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372556:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372578:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847400.372581:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847400.372586:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372609:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9861fbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372633:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372639:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372644:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372649:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847400.372652:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372657:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372666:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c3361100) 00010000:00010000:2.0:1787847400.372669:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847400.372672:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372676:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9861fc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372741:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9861fb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372758:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.372774:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847400.372776:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847400.372779:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6400, rc 0) 00000100:00100000:2.0:1787847400.373091:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:10361:x1874693595366400:12345-192.168.201.21@tcp:101:stat.0 Request processed in 2821us (6915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.373102:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:1.0:1787847400.494253:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847400.494391:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595366656 00000100:00100000:0.0:1787847400.494407:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595366656 00000100:00100000:0.0:1787847400.494542:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:0.0:1787847400.494555:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:10371:x1874693595366656:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847400.494585:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847400.494615:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0caf expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847400.495066:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787847400.495470:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861fd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0caf expref: 42 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.495487:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847400.495491:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847400.495498:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0caf expref: 42 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.495536:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affa00, rc 0) 00000100:00100000:0.0:1787847400.495629:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+41:10371:x1874693595366656:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1077us (1463us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787847400.495638:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:0.0:1787847400.503881:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847400.504089:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595366912 00000100:00100000:3.0:1787847400.504105:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595366912 00000100:00100000:3.0:1787847400.504194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1787847400.504206:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+41:10371:x1874693595366912:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847400.504572:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+42:10371:x1874693595366912:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 366us (715us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787847400.504582:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1787847400.535534:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616369536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847400.535634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847400.535799:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616369536 00000100:00100000:3.0:1787847400.535809:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616369536 00000100:00100000:3.0:1787847400.535885:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787847400.535901:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616369536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787847400.535967:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847400.536024:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fded00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616369536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847400.536054:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787847400.537440:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616369536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847400.576997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847400.577347:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595367168 00000100:00100000:0.0:1787847400.577360:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595367168 00000100:00100000:0.0:1787847400.577459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1787847400.577469:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+42:10377:x1874693595367168:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847400.577502:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847400.577528:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861fe0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cb6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.577658:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.577676:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.577685:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.577731:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.577745:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 43 pid: 5845 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847400.577794:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e012c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616369664:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847400.578074:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f15c99c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847400.581402:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e012c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616369664:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847400.581462:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847400.582613:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847400.582710:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595367296 00000100:00100000:0.0:1787847400.582729:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595367296 00010000:00010000:0.0:1787847400.582786:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 44 pid: 5845 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847400.582831:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:0.0:1787847400.582841:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+44:2347:x1874693595367296:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847400.582868:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847400.582876:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 44 pid: 5845 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.582888:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 44 pid: 5845 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.582921:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9861fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ca8 expref: 44 pid: 5845 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.582968:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847400.582974:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.583001:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.583010:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.583044:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847400.583111:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:2347:x1874693595367296:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 270us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847400.583120:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00010000:00010000:3.0:1787847400.583478:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.583488:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847400.583511:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787847400.583714:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9861fe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.583745:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.583752:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847400.583755:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847400.583757:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe600, rc 0) 00000100:00100000:3.0:1787847400.583798:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:10377:x1874693595367168:12345-192.168.201.21@tcp:101:bash.0 Request processed in 6331us (6817us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787847400.583805:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:1.0:1787847400.587766:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.587885:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595367552 00000100:00100000:2.0:1787847400.587908:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595367552 00000100:00100000:2.0:1787847400.588023:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:2.0:1787847400.588034:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:10377:x1874693595367552:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:2.0:1787847400.588415:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.588439:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.588453:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787847400.588516:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787847400.588549:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099db9555 reply state 00000000c0807204 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847400.588559:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847400.588675:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:10377:x1874693595367552:12345-192.168.201.21@tcp:36:bash.0 Request processed in 641us (920us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787847400.588703:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000020:00080000:2.0:1787847400.588710:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787847400.594131:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.594156:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.594165:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.594181:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847400.594187:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.594197:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.594221:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847400.594225:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847400.594231:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.594262:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9861ff5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847400.596137:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.596468:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595367680 00000100:00100000:2.0:1787847400.596482:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595367680 00000100:00100000:2.0:1787847400.596553:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1787847400.596566:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+45:10377:x1874693595367680:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1787847400.596593:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847400.596622:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cbd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.596742:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.596759:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.596768:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.596817:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.596831:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 46 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847400.596847:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fde580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616369792:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847400.597136:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847400.600452:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fde580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616369792:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847400.600495:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847400.603237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.603393:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595367808 00000100:00100000:2.0:1787847400.603408:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595367808 00010000:00010000:2.0:1787847400.603469:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 47 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847400.603522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:2.0:1787847400.603535:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:2346:x1874693595367808:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847400.603559:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847400.603569:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 47 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.603585:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 47 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.603616:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9861fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cb6 expref: 47 pid: 5844 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.603636:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847400.603643:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.603655:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.603664:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.603725:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847400.603812:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:2346:x1874693595367808:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 279us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.603821:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00010000:00010000:3.0:1787847400.604063:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.604073:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847400.604134:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787847400.604139:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847400.604164:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.604225:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9861ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cbd expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.604244:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cbd expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.604252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847400.604255:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847400.604258:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ac00, rc 0) 00000100:00100000:3.0:1787847400.604305:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+45:10377:x1874693595367680:12345-192.168.201.21@tcp:101:bash.0 Request processed in 7743us (8183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847400.604314:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:1.0:1787847400.607710:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847400.607803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595368064 00000100:00100000:3.0:1787847400.607816:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595368064 00000100:00100000:3.0:1787847400.607889:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1787847400.607906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+45:10377:x1874693595368064:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:3.0:1787847400.608538:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:10377:x1874693595368064:12345-192.168.201.21@tcp:35:bash.0 Request processed in 631us (838us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1787847400.608549:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:0.0:1787847400.729706:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.730043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595368320 00000100:00100000:2.0:1787847400.730056:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595368320 00000100:00100000:2.0:1787847400.730138:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1787847400.730148:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:10387:x1874693595368320:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847400.730185:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847400.730213:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986200a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cc4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847400.730373:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787847400.730553:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986200a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cc4 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.730570:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847400.730573:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847400.730578:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986200a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cc4 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.730595:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b800, rc 0) 00000100:00100000:2.0:1787847400.730675:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:10387:x1874693595368320:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 528us (985us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787847400.730683:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:0.0:1787847400.733784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847400.733879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595368448 00000100:00100000:3.0:1787847400.733892:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595368448 00000100:00100000:3.0:1787847400.734009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:3.0:1787847400.734019:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:10387:x1874693595368448:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:3.0:1787847400.734129:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734487:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734501:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734520:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734526:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734531:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734652:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734659:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734666:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847400.734716:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734730:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734738:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734756:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734762:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847400.734767:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734776:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734791:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847400.734795:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847400.734799:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734805:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734823:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734829:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734834:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734838:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847400.734841:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734856:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734864:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c3361900) 00010000:00010000:3.0:1787847400.734867:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847400.734870:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734876:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986201f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734893:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734900:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734907:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734912:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847400.734915:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734922:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734929:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847400.734960:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847400.734964:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847400.734981:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847400.735547:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e02940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:10387:x1874693595368448:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1523us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847400.735558:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:1.0:1787847400.747180:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847400.747602:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595368704 00000100:00100000:0.0:1787847400.747615:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595368704 00000100:00100000:0.0:1787847400.747690:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1787847400.747701:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:10387:x1874693595368704:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847400.748122:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:10387:x1874693595368704:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 419us (961us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787847400.748131:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1787847400.849121:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847400.851644:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595368960 00000100:00100000:2.0:1787847400.851693:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595368960 00000100:00100000:2.0:1787847400.851796:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:2.0:1787847400.851809:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:10390:x1874693595368960:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847400.851845:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847400.851874:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986202d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ccb expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852025:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852044:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852059:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852091:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852100:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852107:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852554:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852564:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852572:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847400.852593:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787847400.852715:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852724:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852730:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852737:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847400.852741:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852749:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852763:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847400.852766:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847400.852771:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852779:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862034 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852795:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852801:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852817:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852822:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847400.852826:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852833:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852841:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7f000) 00010000:00010000:2.0:1787847400.852844:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847400.852846:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852853:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986203b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852912:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986202d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ccb expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.852928:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ccb expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.853008:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847400.853010:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847400.853012:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847400.853610:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e02d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10390:x1874693595368960:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1799us (4500us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787847400.853636:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1787847400.866479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847400.866597:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847400.866725:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595369088 00000100:00100000:0.0:1787847400.866739:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595369088 00000100:00100000:0.0:1787847400.866842:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:0.0:1787847400.866856:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:2345:x1874693595369088:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847400.866879:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847400.866915:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ccb expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847400.866980:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847400.866987:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847400.867080:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:2345:x1874693595369088:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 213us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847400.867090:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:2.0:1787847400.867780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595369216 00000100:00100000:2.0:1787847400.867788:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595369216 00000100:00100000:2.0:1787847400.867833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:2.0:1787847400.867841:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:10390:x1874693595369216:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1787847400.867916:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.867967:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.867980:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868012:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868019:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868026:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868032:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847400.868036:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868044:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868053:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847400.868386:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847400.868396:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847400.868402:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847400.868472:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:10390:x1874693595369216:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 632us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847400.868481:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:1.0:1787847400.896590:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847400.896704:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595369472 00000100:00100000:0.0:1787847400.896717:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595369472 00000100:00100000:0.0:1787847400.896795:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1787847400.896808:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:10390:x1874693595369472:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847400.897438:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10390:x1874693595369472:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 631us (861us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787847400.897448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00010000:00010000:1.0:1787847400.928193:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847401.190553:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.190836:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595369728 00000100:00100000:2.0:1787847401.190851:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595369728 00000100:00100000:2.0:1787847401.190964:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:2.0:1787847401.190978:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10408:x1874693595369728:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1787847401.191018:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847401.191048:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cd2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.191184:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986205e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.191203:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986205e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.191220:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986205e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847401.191234:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787847401.191423:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cd2 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.191468:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986205e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cd2 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.191478:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847401.191481:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787847401.191486:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847401.191705:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10408:x1874693595369728:12345-192.168.201.21@tcp:101:cat.0 Request processed in 726us (1163us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787847401.191715:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:1.0:1787847401.217478:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847401.217774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595369856 00000100:00100000:3.0:1787847401.217788:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595369856 00000100:00100000:3.0:1787847401.217927:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:3.0:1787847401.217980:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10409:x1874693595369856:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847401.218019:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847401.218047:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986206c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cd9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.218188:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.218213:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.218229:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847401.218309:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787847401.218313:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847401.218337:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.218380:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986206c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cd9 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.218410:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cd9 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.218419:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847401.218422:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847401.218427:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7600, rc 0) 00000100:00100000:3.0:1787847401.218509:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10409:x1874693595369856:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 534us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847401.218516:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:1.0:1787847401.225397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847401.225509:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595370240 00000100:00100000:0.0:1787847401.225522:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595370240 00000100:00100000:0.0:1787847401.225631:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1787847401.225644:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10409:x1874693595370240:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847401.226282:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10409:x1874693595370240:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 636us (895us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787847401.226293:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1787847401.230081:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.230210:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595370368 00000100:00100000:2.0:1787847401.230224:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595370368 00000100:00100000:2.0:1787847401.230314:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:2.0:1787847401.230327:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10409:x1874693595370368:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:2.0:1787847401.230350:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787847401.230396:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cbd expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.230422:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986205e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cd2 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.230433:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9861f0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c7e expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.230445:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847401.230459:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847401.230537:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:10409:x1874693595370368:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 213us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847401.230545:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:1.0:1787847401.235826:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.235924:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595370496 00000100:00100000:2.0:1787847401.235956:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595370496 00000100:00100000:2.0:1787847401.236033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:2.0:1787847401.236046:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:10409:x1874693595370496:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:2.0:1787847401.236224:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.236245:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.236260:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847401.236623:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847401.236838:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787847401.236963:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787847401.237101:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:10409:x1874693595370496:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 1053us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847401.237112:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:0.0:1787847401.277143:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.277232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595370624 00000100:00100000:2.0:1787847401.277243:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595370624 00000100:00100000:2.0:1787847401.277310:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:2.0:1787847401.277322:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:10411:x1874693595370624:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847401.277351:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847401.277395:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ce0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277510:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277529:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277544:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277559:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277566:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277572:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277695:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277703:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.277709:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847401.277755:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787847401.278438:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847401.278475:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278508:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278517:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278523:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278530:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278536:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847401.278541:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278549:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278563:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847401.278566:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847401.278571:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278577:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862088 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278590:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278595:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278608:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278612:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847401.278615:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278620:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278626:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7fb00) 00010000:00010000:2.0:1787847401.278628:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847401.278631:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278635:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986208f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278677:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278691:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.278697:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:2.0:1787847401.278699:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847401.278701:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:2.0:1787847401.278997:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e03840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10411:x1874693595370624:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1672us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847401.279016:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000040:00080000:0.0:1787847401.819148:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847401.819159:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847401.819231:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787847401.819240:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787847401.820115:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e02580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616369920:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787847401.820922:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f15c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787847401.844151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847401.844385:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e02580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616369920:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787847401.850579:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595370752 00000100:00100000:3.0:1787847401.850604:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595370752 00000100:00100000:3.0:1787847401.851389:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:3.0:1787847401.851409:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595370752:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787847401.853490:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595370752:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 Request processed in 2071us (9337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847401.853508:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1787847401.861135:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847401.861180:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595370880 00000100:00100000:1.0:1787847401.861193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595370880 00000100:00100000:1.0:1787847401.861278:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:1.0:1787847401.861291:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595370880:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787847401.861336:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787847401.861484:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595370880:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 196us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847401.861493:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:0.0:1787847401.872765:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847401.872856:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595371008 00000100:00100000:3.0:1787847401.872870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595371008 00000100:00100000:3.0:1787847401.872980:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:3.0:1787847401.872993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595371008:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787847401.873095:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873120:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873150:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873169:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873177:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873185:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873220:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873229:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873236:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847401.873366:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787847401.873373:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847401.873395:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873410:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873418:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873437:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873443:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847401.873448:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873457:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873472:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:3.0:1787847401.873476:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847401.873482:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873490:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986209d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873505:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873512:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873518:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873523:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847401.873527:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873542:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873552:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d87c3361900) 00010000:00010000:3.0:1787847401.873555:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847401.873558:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873565:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873581:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873589:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873595:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873601:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847401.873604:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873611:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873618:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:3.0:1787847401.873621:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847401.873624:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.873641:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847401.873750:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e02580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595371008:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 756us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847401.873759:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:2.0:1787847401.888329:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847401.888474:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595371264 00000100:00100000:1.0:1787847401.888487:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595371264 00000100:00100000:1.0:1787847401.888565:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:1.0:1787847401.888578:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10422:x1874693595371264:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847401.888606:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847401.888635:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98620b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ce7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.888788:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.888807:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.888823:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847401.888836:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787847401.889165:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889190:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889197:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889203:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847401.889208:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889216:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889230:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:1.0:1787847401.889233:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787847401.889239:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889246:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b98620b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889381:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98620b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce7 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889395:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:1.0:1787847401.889398:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787847401.889402:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98620b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce7 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847401.889413:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4400, rc 0) 00000100:00100000:1.0:1787847401.889542:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10422:x1874693595371264:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 967us (1228us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787847401.889552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:0.0:1787847401.898094:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847401.898213:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595371392 00000100:00100000:3.0:1787847401.898227:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595371392 00000100:00100000:3.0:1787847401.898311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:3.0:1787847401.898324:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10422:x1874693595371392:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787847401.898415:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787847401.898571:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10422:x1874693595371392:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 249us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847401.898579:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:0.0:1787847401.912228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.912405:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595371648 00000100:00100000:2.0:1787847401.912420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595371648 00000100:00100000:2.0:1787847401.912500:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:2.0:1787847401.912511:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10422:x1874693595371648:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847401.912538:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847401.912542:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787847401.912578:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cd9 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.912601:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847401.912607:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847401.912625:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b98620c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cee expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787847401.913227:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787847401.914967:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98620ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.914994:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98620ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.915007:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98620ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.915102:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b98620c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cee expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.915136:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98620ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cee expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.915147:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c4d7fb00) 00010000:00010000:2.0:1787847401.915150:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847401.915153:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b800, rc 0) 00000100:00100000:2.0:1787847401.915253:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10422:x1874693595371648:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2742us (3038us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787847401.915273:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:2.0:1787847401.925918:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847401.926174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595371904 00000100:00100000:3.0:1787847401.926187:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595371904 00000100:00100000:3.0:1787847401.926367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:3.0:1787847401.926381:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10422:x1874693595371904:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787847401.926466:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847401.926506:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98620ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cee expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.926531:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c4d7fb00) 00010000:00010000:3.0:1787847401.926545:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847401.926576:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.926607:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.926618:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933283:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933318:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933333:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933463:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933471:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933478:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933483:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847401.933506:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933515:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933531:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847401.933534:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847401.933539:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933546:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98620dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933561:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933566:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933572:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933576:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847401.933579:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933583:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933589:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4c66565f (ffff8d87c4d7f100) 00010000:00010000:2.0:1787847401.933591:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847401.933599:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.933605:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4c66565f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847401.933762:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10422:x1874693595371904:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 7369us (7846us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787847401.933773:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:0.0:1787847401.939091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847401.939434:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595372032 00000100:00100000:3.0:1787847401.939448:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595372032 00000100:00100000:3.0:1787847401.939558:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:3.0:1787847401.939570:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10422:x1874693595372032:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847401.939601:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847401.939639:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cf5 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.939689:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.939720:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.939735:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.939879:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98620ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 55 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.939910:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 54 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847401.940128:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847401.940132:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787847401.940137:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847401.940220:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10422:x1874693595372032:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 651us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847401.940229:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00010000:00010000:3.0:1787847401.944424:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847401.959642:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.959729:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595372288 00000100:00100000:2.0:1787847401.959743:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595372288 00000100:00100000:2.0:1787847401.959823:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:2.0:1787847401.959838:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10422:x1874693595372288:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787847401.959983:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.960005:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.960021:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847401.960616:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787847401.960631:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 316784698768ns, next at 317784695514ns, rc = 0 00000004:00010000:2.0:1787847401.960754:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000865767dc reply state 00000000a9cf5127 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847401.960765:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847401.960905:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e01e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10422:x1874693595372288:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 1069us (1276us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787847401.960967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00010000:00010000:2.0:1787847401.964743:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.964770:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.964779:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.964787:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847401.964794:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.964802:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.964826:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:2.0:1787847401.964830:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787847401.964836:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.964843:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98620f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847401.967665:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847401.967845:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595372416 00000100:00100000:2.0:1787847401.967856:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595372416 00000100:00100000:2.0:1787847401.967988:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:2.0:1787847401.968000:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10422:x1874693595372416:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847401.968046:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847401.968093:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0cfc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.968179:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.968193:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847401.968211:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:2.0:1787847401.968214:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787847401.968218:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847401.968285:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e03c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10422:x1874693595372416:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 289us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847401.968291:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:0.0:1787847401.971973:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847401.977133:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595372544 00000100:00100000:1.0:1787847401.977153:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595372544 00000100:00100000:1.0:1787847401.977320:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:1.0:1787847401.977334:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874693595372544:12345-192.168.201.21@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787847401.977389:0:6678:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp t0 exp 0000000000000000 cur 316 last 0 00000020:00000080:1.0:1787847401.977435:0:6678:0:(genops.c:1385:class_connect()) connect: client 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3, cookie 0x1835de88b9862106 00002000:00100000:1.0:1787847401.977454:0:6678:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3/ffff8d87ef4bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787847401.977469:0:6678:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787847401.978385:0:6678:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787847401.978439:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8d87ef4ba000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847401.978597:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2343:x1874693595372544:12345-192.168.201.21@tcp:8:lhsmtool_posix.0 Request processed in 1262us (6671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847401.978608:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1787847401.984713:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847401.987190:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595372672 00000100:00100000:1.0:1787847401.987213:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595372672 00000100:00100000:1.0:1787847401.987426:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1787847401.987442:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:0:x1874693595372672:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787847401.988366:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1787847402.090863:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1787847402.090889:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000100:00100000:1.0:1787847402.091100:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:0:x1874693595372672:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 103653us (106397us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787847402.091114:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:3.0:1787847402.099690:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.100921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595372928 00000100:00100000:3.0:1787847402.100963:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595372928 00000100:00100000:3.0:1787847402.101053:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847402.101067:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10422:x1874693595372928:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787847402.101475:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10422:x1874693595372928:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 407us (1794us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787847402.101485:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00080000:3.0:1787847402.101512:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847402.111810:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.116698:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595373184 00000100:00100000:3.0:1787847402.120400:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595373184 00000100:00100000:3.0:1787847402.120529:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:3.0:1787847402.120544:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10422:x1874693595373184:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787847402.120717:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10422:x1874693595373184:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 176us (8921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847402.120734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:2.0:1787847402.128694:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847402.128762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595373312 00000100:00100000:2.0:1787847402.128776:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595373312 00000100:00100000:2.0:1787847402.128847:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:2.0:1787847402.128860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10422:x1874693595373312:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847402.128891:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847402.128921:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986210d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d03 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.129072:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862114 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.129102:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.129117:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847402.129168:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847402.129195:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862114 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.129231:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986210d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d03 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.129251:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862114 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d03 expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.129262:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:2.0:1787847402.129266:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787847402.129270:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ae00, rc 0) 00000100:00100000:2.0:1787847402.129364:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10422:x1874693595373312:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 505us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847402.129374:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:3.0:1787847402.138801:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847402.138965:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595373440 00000100:00100000:0.0:1787847402.138979:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595373440 00000100:00100000:0.0:1787847402.139056:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:0.0:1787847402.139069:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595373440:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847402.139094:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847402.139125:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d0a expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787847402.139161:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9062ea, blocks: 0x1 00010000:00010000:0.0:1787847402.139188:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=316s v=(0 0) 00010000:00010000:0.0:1787847402.139194:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847402.139207:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.139234:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.139253:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe800, rc 0) 00000100:00100000:0.0:1787847402.139326:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595373440:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 259us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847402.139334:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:2.0:1787847402.146503:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.146608:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595373696 00000100:00100000:3.0:1787847402.146622:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595373696 00000100:00100000:3.0:1787847402.146704:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:3.0:1787847402.146717:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10422:x1874693595373696:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787847402.146872:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10422:x1874693595373696:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 157us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847402.146880:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:3.0:1787847402.153069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847402.153542:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595373824 00000100:00100000:1.0:1787847402.153557:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595373824 00000100:00100000:1.0:1787847402.153642:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:1.0:1787847402.153655:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:10422:x1874693595373824:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847402.153683:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847402.153711:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d11 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.153755:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.153767:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847402.153773:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847402.153780:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.153828:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.153846:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.153864:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874693616370048:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847402.154016:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847402.161778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.164561:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874693616370048:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847402.164621:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.164650:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4400, rc 0) 00000100:00100000:3.0:1787847402.164755:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:10422:x1874693595373824:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 11103us (11703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847402.164766:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:2.0:1787847402.165899:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595373952 00000100:00100000:2.0:1787847402.165914:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595373952 00010000:00010000:2.0:1787847402.165994:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847402.166060:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:2.0:1787847402.166071:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f89050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595373952:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847402.166089:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847402.166120:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.166136:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.166169:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b986211b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d0a expref: 7 pid: 6677 timeout: 416 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.166187:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847402.166191:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847402.166201:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.166212:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.166253:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847402.166269:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874693616370176:192.168.201.21@tcp:105: 00000100:00100000:2.0:1787847402.166383:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbccd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847402.177976:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847402.179138:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874693616370176:192.168.201.21@tcp:105: 00010000:00010000:2.0:1787847402.179182:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847402.179287:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f89050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595373952:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 13215us (17521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847402.179301:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:1.0:1787847402.179846:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595374080 00000100:00100000:1.0:1787847402.179858:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595374080 00002000:00100000:1.0:1787847402.179919:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d87e6e01a40 x1874693595374080/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:618/0 lens 504/0 e 0 to 0 dl 1787847413 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787847402.179963:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6e01a40 with x1874693595374080 ext(0->8) 00002000:00010000:1.0:1787847402.179969:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87e6e01a40 00000100:00100000:1.0:1787847402.180002:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:1.0:1787847402.180013:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595374080:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787847402.182921:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e01a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595374080:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 2900us (4946us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787847402.182992:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00002000:00100000:1.0:1787847402.183006:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d87e6e01a40 x1874693595374080/t4294967302(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:618/0 lens 504/448 e 0 to 0 dl 1787847413 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787847402.183017:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6e01a40 with x1874693595374080 ext(0->8) 00002000:00010000:1.0:1787847402.183024:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87e6e01a40 00000001:00080000:1.0:1787847402.187581:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:1.0:1787847402.187629:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:1.0:1787847402.187651:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1787847402.187658:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787847402.187758:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787847402.187784:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d87f51b00c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787847402.187790:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d87f51b0b40 00000020:00080000:1.0:1787847402.187793:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87f9dd8000 00000100:00100000:3.0:1787847402.188110:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616370432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787847402.188206:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787847402.188207:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1787847402.188275:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847402.188287:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616370304:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1787847402.188323:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787847402.188332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847402.188409:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616370432 00000100:00100000:1.0:1787847402.188412:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616370304 00000100:00100000:1.0:1787847402.188422:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616370304 00000100:00100000:0.0:1787847402.188435:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616370432 00000100:00100000:1.0:1787847402.188502:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787847402.188524:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616370304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787847402.188553:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787847402.188587:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9062e7, atime: 0x6a9062e7, ctime: 0x6a9062e7, blocks: 0xb 00010000:00010000:1.0:1787847402.188596:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.188611:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:1.0:1787847402.188615:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847402.188622:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.188638:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.188647:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.188654:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.188670:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787847402.188705:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787847402.188724:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616370432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787847402.189478:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787847402.189485:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787847402 00002000:00010000:0.0:1787847402.189488:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787847402.189491:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787847402 -> 1787847402 00002000:00010000:0.0:1787847402.189494:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787847402.189566:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616370432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 848us (1359us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787847402.189576:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787847402.189682:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3303:x1874693616370304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1156us (1351us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787847402.189693:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787847402.189731:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847402.189738:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.189760:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4a00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847402.189765:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.189775:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.189792:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.189800:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862129 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.189820:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847402.189821:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847402.189823:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787847402.190714:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847402.190746:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787847402.190845:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87e6d28780/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787847402.190859:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616370304:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1787847402.190877:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87e6e003c0/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787847402.190882:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616370432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787847402.191637:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.193528:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595374208 00000100:00100000:3.0:1787847402.193547:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595374208 00000100:00100000:3.0:1787847402.193657:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1787847402.193671:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10422:x1874693595374208:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787847402.193886:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e01680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10422:x1874693595374208:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 217us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847402.193896:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1787847402.197974:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847402.198081:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595374336 00000100:00100000:0.0:1787847402.198095:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595374336 00000100:00100000:0.0:1787847402.198171:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:0.0:1787847402.198183:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595374336:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000040:00080000:0.0:1787847402.241722:0:11998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847402.241733:0:11998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847402.241785:0:11998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787847402.242376:0:11998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787847402.261411:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787847402.261436:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787847402.261727:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595374336:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 63535us (63786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847402.261751:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:0.0:1787847402.265314:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.265416:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595374592 00000100:00100000:3.0:1787847402.265429:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595374592 00000100:00100000:3.0:1787847402.265528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:3.0:1787847402.265541:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10422:x1874693595374592:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787847402.265623:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847402.265666:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862114 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d03 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.265691:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847402.265698:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847402.265752:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.265787:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.265800:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847402.266087:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004686ecc0 reply state 00000000956c20f4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847402.266098:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847402.266239:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10422:x1874693595374592:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 699us (938us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787847402.266249:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00010000:00010000:0.0:1787847402.270568:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.270594:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.270615:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.270623:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847402.270630:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.270640:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.270667:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:0.0:1787847402.270671:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847402.270678:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.270687:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862130 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847402.273266:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.273629:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595374720 00000100:00100000:3.0:1787847402.273643:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595374720 00000100:00100000:3.0:1787847402.273735:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:3.0:1787847402.273760:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595374720:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787847402.274169:0:7920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787847402.274174:0:7920:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787847402 -> 1787847401 00002000:00010000:3.0:1787847402.274177:0:7920:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787847399 00002000:00010000:3.0:1787847402.274180:0:7920:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787847402 -> 1787847401 00002000:00010000:3.0:1787847402.274182:0:7920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787847402.274263:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595374720:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 516us (1011us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787847402.274274:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:0.0:1787847402.280028:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847402.280148:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595374976 00000100:00100000:1.0:1787847402.280162:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595374976 00000100:00100000:1.0:1787847402.280238:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:1.0:1787847402.280251:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10422:x1874693595374976:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787847402.280375:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.280397:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 14 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.280423:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.280469:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 14 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.280485:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 14 pid: 7214 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.280503:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616370560:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847402.280618:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e540 going to sleep for 11 seconds 00000100:00100000:1.0:1787847402.286634:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616370560:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847402.286683:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847402.288689:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847402.292628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595375104 00000100:00100000:1.0:1787847402.292650:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595375104 00010000:00010000:0.0:1787847402.296874:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 15 pid: 7214 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847402.297032:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:0.0:1787847402.297048:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:2347:x1874693595375104:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847402.297069:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847402.297077:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 15 pid: 7214 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.297107:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 15 pid: 7214 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.297139:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98620f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cf5 expref: 15 pid: 7214 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.297155:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:0.0:1787847402.297161:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.297171:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.297180:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.297225:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847402.297299:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:2347:x1874693595375104:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 256us (8620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847402.297308:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00010000:00010000:3.0:1787847402.298773:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298825:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298867:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298874:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298882:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298888:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847402.298893:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298901:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298921:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847402.298924:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787847402.298946:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.298955:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b9862137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847402.299062:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10422:x1874693595374976:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 18809us (19045us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787847402.299073:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:0.0:1787847402.304326:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847402.307093:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595375232 00000100:00100000:1.0:1787847402.307116:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595375232 00000100:00100000:1.0:1787847402.307247:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:1.0:1787847402.307262:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2345:x1874693595375232:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787847402.307326:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.307364:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.307391:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787847402.307397:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847402.307403:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.307450:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.307467:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 7 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.307496:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874693616370688:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847402.307622:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e540 going to sleep for 11 seconds 00000100:00100000:3.0:1787847402.319929:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.319994:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595375360 00000100:00100000:3.0:1787847402.320004:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595375360 00010000:00010000:3.0:1787847402.320104:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 8 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847402.320152:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1787847402.320163:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595375360:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847402.320180:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847402.320209:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 8 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.320225:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 8 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.320257:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847402.320262:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847402.320270:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.320282:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.320306:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847402.323089:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f97412a/0x1835de88b9862122 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d11 expref: 8 pid: 6679 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847402.323125:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874693616370688:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847402.323165:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323208:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323217:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323265:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323274:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323285:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323293:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847402.323298:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323308:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323332:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847402.323360:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e034948/0x1835de88b986213e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847402.325695:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595375360:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 5518us (5767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847402.325713:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1787847402.327687:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595375232:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 20414us (23358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847402.327894:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1787847402.332965:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847402.333622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595375616 00000100:00100000:2.0:1787847402.333639:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595375616 00000100:00100000:2.0:1787847402.333734:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:2.0:1787847402.333752:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10422:x1874693595375616:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787847402.333877:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.333899:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.333913:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.334269:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.334284:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.334293:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.334354:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.334383:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 14 pid: 5843 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847402.334402:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616370816:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847402.334523:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787847402.340056:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.340130:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616370816:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847402.340175:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.340473:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595375744 00000100:00100000:1.0:1787847402.340494:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595375744 00010000:00010000:1.0:1787847402.340541:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 15 pid: 5843 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.340586:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:1.0:1787847402.340598:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:2346:x1874693595375744:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847402.340622:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847402.340632:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 15 pid: 5843 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.340648:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 15 pid: 5843 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.340693:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b98620ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0cfc expref: 15 pid: 5843 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.340710:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:1.0:1787847402.340717:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.340741:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.340750:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.340782:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847402.340806:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.340813:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.340997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:2346:x1874693595375744:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 400us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847402.341007:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000001:00080000:3.0:1787847402.341131:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787847402.341325:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787847402.341388:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787847402.341479:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874693616370944:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787847402.341546:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847402.341584:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847402.341956:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616370944 00000100:00100000:1.0:1787847402.341964:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616370944 00000100:00100000:1.0:1787847402.342012:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847402.342024:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874693616370944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787847402.342112:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874693616370944:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847402.342119:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847402.343557:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787847402.343573:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87e6e003c0, transno 4294967303 00000100:00100000:3.0:1787847402.343600:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874693616370944:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787847402.344656:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787847402.344780:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874693616371072:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787847402.344879:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847402.344920:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33900 going to sleep for 11 seconds 00000100:00100000:1.0:1787847402.345030:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616371072 00000100:00100000:1.0:1787847402.345040:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616371072 00000100:00100000:1.0:1787847402.345101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847402.345111:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5844:x1874693616371072:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787847402.345393:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1874693616371072:12345-0@lo:1000:mdt00_001.0 Request processed in 281us (513us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787847402.345402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847402.345579:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5844:1874693616371072:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787847402.345642:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345654:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345663:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345672:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847402.345678:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345687:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345712:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847402.345716:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847402.345722:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345730:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986214c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345847:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345855:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345949:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345966:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847402.345970:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345976:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345986:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:3.0:1787847402.345989:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847402.345992:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.345998:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986207a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.346049:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.346131:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.346152:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.346191:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.346209:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 17 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847402.346248:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800857c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616371200:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847402.346362:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847402.364243:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847402.364292:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595375872 00000100:00100000:1.0:1787847402.364304:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595375872 00010000:00010000:1.0:1787847402.364372:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 18 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847402.364423:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1787847402.364436:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2347:x1874693595375872:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847402.364454:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847402.364462:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 18 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.364488:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 18 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.364518:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:1.0:1787847402.364524:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.364535:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.364544:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847402.364566:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847402.364649:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2347:x1874693595375872:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 215us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847402.364658:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00010000:00010000:3.0:1787847402.366653:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ce0 expref: 17 pid: 5845 timeout: 417 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847402.366683:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800857c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616371200:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847402.366714:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.366884:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.366893:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.366909:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.366918:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.366927:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367231:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847402.367237:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367245:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367279:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:3.0:1787847402.367282:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847402.367288:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367295:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862153 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367307:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367313:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367318:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367323:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847402.367326:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367331:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367351:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f000) 00010000:00010000:3.0:1787847402.367353:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787847402.367356:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.367362:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787847402.368100:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847402.368109:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847402.368142:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787847402.368149:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787847402.368267:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:10422:x1874693595375616:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 34511us (35339us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1787847402.368282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00000020:00080000:3.0:1787847402.368290:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787847402.378574:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847402.378709:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595376128 00000100:00100000:3.0:1787847402.378734:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595376128 00000100:00100000:3.0:1787847402.378967:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1787847402.378981:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:10422:x1874693595376128:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787847402.380210:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787847402.380351:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787847402.380418:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.380439:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.380455:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.380464:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.380472:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.380927:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847402.380985:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787847402.381145:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:10422:x1874693595376128:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 2161us (2580us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787847402.381157:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000020:00080000:3.0:1787847402.381165:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787847402.381733:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847402.381749:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.381760:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847402.381765:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.381775:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.382030:0:7621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:2.0:1787847402.382035:0:7621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787847402.382042:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.382049:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986215a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847402.382069:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847402.382072:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847402.382073:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847402.970360:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787847403.415201:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847403.415215:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847403.415254:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787847403.415262:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787847403.441656:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847403.441870:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847403.441912:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847403.441958:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847403.441997:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847403.442040:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595376640 00000100:00100000:3.0:1787847403.442052:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595376640 00000100:00100000:3.0:1787847403.442198:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595376512 00000100:00100000:1.0:1787847403.442311:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595376384 00000100:00100000:1.0:1787847403.442325:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595376384 00000100:00100000:3.0:1787847403.442368:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595376512 00000100:00100000:1.0:1787847403.442368:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595376768 00000100:00100000:1.0:1787847403.442371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595376768 00000100:00100000:3.0:1787847403.442401:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:1.0:1787847403.442401:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:3.0:1787847403.442413:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880017a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595376640:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847403.442413:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2344:x1874693595376384:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847403.442503:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880017a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595376640:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 93us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847403.442513:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:0.0:1787847403.442528:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:0.0:1787847403.442543:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800855e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595376512:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847403.442763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595376256 00000100:00100000:3.0:1787847403.442768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595376256 00000100:00100000:3.0:1787847403.442796:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 285 00000100:00100000:3.0:1787847403.442803:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595376256:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847403.447632:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2344:x1874693595376384:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 5201us (5972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847403.447654:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:0.0:1787847403.447793:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800855e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595376512:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 5250us (5829us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847403.447807:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:1.0:1787847403.447884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:1.0:1787847403.447906:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595376768:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847403.448017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595376768:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 120us (6019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847403.448025:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00080000:1.0:1787847403.448111:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787847403.448120:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787847403.448124:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847403.448188:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595376256:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 5382us (6274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847403.448200:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 285 00000100:00100000:1.0:1787847403.617038:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847403.617071:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616371328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847403.617170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847403.622507:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616371328 00000100:00100000:3.0:1787847403.622530:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616371328 00000100:00100000:3.0:1787847403.622632:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787847403.622644:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616371328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847403.622714:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847403.623859:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616371328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847403.628570:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616371328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5914us (11386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847403.628589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1787847403.993205:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847404.193715:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000040:00080000:3.0:1787847404.477285:0:12051:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787847404.477308:0:12051:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787847404.477356:0:12051:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787847404.477365:0:12051:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787847404.689272:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847404.689796:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595377024 00000100:00100000:1.0:1787847404.689810:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595377024 00000100:00100000:1.0:1787847404.690219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:1.0:1787847404.690232:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:10441:x1874693595377024:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847404.690263:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847404.690291:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d18 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.690650:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4e00/0x1835de88b9862168 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.690693:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4e00/0x1835de88b9862168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.690792:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4e00/0x1835de88b9862168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847404.690808:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787847404.691127:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d18 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.691147:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4e00/0x1835de88b9862168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d18 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.691166:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:1.0:1787847404.691168:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787847404.691173:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4e00, rc 0) 00000100:00100000:1.0:1787847404.691259:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10441:x1874693595377024:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1030us (2003us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787847404.691268:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00080000:2.0:1787847404.694715:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847404.695961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847404.696046:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595377152 00000100:00100000:2.0:1787847404.696058:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595377152 00000100:00100000:2.0:1787847404.696127:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:2.0:1787847404.696139:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10441:x1874693595377152:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:2.0:1787847404.696242:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696263:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696278:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696308:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696316:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696322:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696688:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696697:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696774:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847404.696825:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696850:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696856:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696864:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696870:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847404.696876:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696883:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696898:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847404.696901:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847404.696906:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696912:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696926:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696965:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696972:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696983:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847404.696986:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.696992:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697000:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7ff00) 00010000:00010000:2.0:1787847404.697003:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847404.697006:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697012:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986217d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697027:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697033:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697038:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697043:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847404.697045:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697051:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697069:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c4d7f100) 00010000:00010000:2.0:1787847404.697071:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847404.697074:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.697079:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b9862184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847404.697180:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10441:x1874693595377152:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1041us (1251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847404.697189:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:1.0:1787847404.758840:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847404.759090:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595377408 00000100:00100000:3.0:1787847404.759103:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595377408 00000100:00100000:3.0:1787847404.759174:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:3.0:1787847404.759186:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10444:x1874693595377408:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847404.759214:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847404.759241:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b986218b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759351:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759369:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759384:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759403:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759427:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759435:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759832:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759843:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.759850:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847404.759863:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787847404.762039:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762056:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762064:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762070:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847404.762075:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762084:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762116:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847404.762119:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847404.762125:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762132:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762148:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762155:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762161:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762167:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847404.762170:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762176:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762184:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c3361c00) 00010000:00010000:3.0:1787847404.762186:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847404.762188:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762193:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762271:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b986218b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762287:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.762309:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847404.762311:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847404.762314:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847404.762404:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d283c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:10444:x1874693595377408:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 3219us (3580us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787847404.762415:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:3.0:1787847404.772182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847404.772317:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595377536 00000100:00100000:1.0:1787847404.772330:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595377536 00000100:00100000:1.0:1787847404.772407:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1787847404.772419:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800857840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:10444:x1874693595377536:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:1.0:1787847404.772524:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772557:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772571:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772609:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772617:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772625:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772648:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847404.772653:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772662:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772679:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847404.772682:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787847404.772689:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.772696:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847404.772811:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800857840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:10444:x1874693595377536:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 392us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847404.773062:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1787847404.776781:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847404.776878:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595377792 00000100:00100000:3.0:1787847404.776890:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595377792 00000100:00100000:3.0:1787847404.776999:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:3.0:1787847404.777011:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:10444:x1874693595377792:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847404.777337:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:10444:x1874693595377792:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 327us (569us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787847404.777347:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:2.0:1787847404.845751:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847404.845866:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378048 00000100:00100000:3.0:1787847404.845882:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378048 00000100:00100000:3.0:1787847404.845984:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:3.0:1787847404.845996:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:9966:x1874693595378048:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847404.846030:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847404.846073:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98621b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d26 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.846207:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.846225:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.846236:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.846278:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.846305:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 24 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847404.846321:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800854780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616371456:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847404.846433:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847404.855644:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800854780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616371456:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847404.855690:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847404.861204:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847404.861781:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378176 00000100:00100000:0.0:1787847404.861797:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378176 00010000:00010000:0.0:1787847404.862119:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 25 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847404.862216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:0.0:1787847404.862228:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+25:2347:x1874693595378176:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847404.862248:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847404.862258:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 25 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.862308:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 25 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.862338:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98621a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d1f expref: 25 pid: 5843 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.862356:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847404.862362:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.862373:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.862382:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.862417:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847404.862497:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:2347:x1874693595378176:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 270us (1312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847404.862505:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00010000:00010000:3.0:1787847404.862559:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.862568:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847404.862593:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787847404.862798:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98621b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.862842:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.862850:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847404.862862:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847404.862865:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7200, rc 0) 00000100:00100000:3.0:1787847404.862897:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:9966:x1874693595378048:12345-192.168.201.21@tcp:101:bash.0 Request processed in 16903us (17162us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787847404.862905:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:0.0:1787847404.871378:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847404.871481:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378432 00000100:00100000:1.0:1787847404.871496:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378432 00000100:00100000:1.0:1787847404.871568:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 89 00000100:00100000:1.0:1787847404.871580:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:9966:x1874693595378432:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:1.0:1787847404.871986:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.872023:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847404.872058:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847404.872125:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1787847404.872152:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036ee15da reply state 0000000092b4dede transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847404.872161:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787847404.872212:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1787847404.872364:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:9966:x1874693595378432:12345-192.168.201.21@tcp:36:bash.0 Request processed in 784us (995us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1787847404.872372:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 89 00000020:00080000:1.0:1787847404.872377:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787847404.876188:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:2.0:1787847404.876578:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.876594:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.876603:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.876610:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847404.876616:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.876624:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.876649:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847404.876673:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847404.876681:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847404.876687:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98621ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847404.876986:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378560 00000100:00100000:3.0:1787847404.876998:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378560 00000100:00100000:3.0:1787847404.877080:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:3.0:1787847404.877092:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:9966:x1874693595378560:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847404.877123:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847404.877145:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98621d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.877222:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98621d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d2d expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.877239:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98621d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d2d expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.877261:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847404.877264:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847404.877275:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7600, rc 0) 00000100:00100000:3.0:1787847404.877369:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:9966:x1874693595378560:12345-192.168.201.21@tcp:101:bash.0 Request processed in 278us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847404.877377:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:0.0:1787847404.881697:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847404.881750:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378688 00000100:00100000:3.0:1787847404.881764:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378688 00000100:00100000:3.0:1787847404.881851:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:3.0:1787847404.881862:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:9966:x1874693595378688:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847404.881894:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847404.881925:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d34 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847404.882112:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9062e9, atime: 0x6a9062e7, ctime: 0x6a9062e9, blocks: 0xb 00010000:00010000:3.0:1787847404.882146:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=319s v=(0 0) 00010000:00010000:3.0:1787847404.882152:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847404.882162:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.882185:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847404.882260:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6000, rc 0) 00000100:00100000:3.0:1787847404.882352:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:9966:x1874693595378688:12345-192.168.201.21@tcp:101:bash.0 Request processed in 491us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847404.882361:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:1.0:1787847404.884594:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847404.884642:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378816 00000100:00100000:3.0:1787847404.884654:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378816 00002000:00010000:3.0:1787847404.884794:0:6682:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787847404.884801:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6d28f00 with x1874693595378816 ext(0->18446744073709551615) 00002000:00010000:3.0:1787847404.884872:0:6682:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87e6d28f00. 00000100:00100000:3.0:1787847404.884913:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:3.0:1787847404.884925:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595378816:12345-192.168.201.21@tcp:10:bash.0 00002000:00010000:2.0:1787847404.885546:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787847404.885552:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787847401 -> 1787847405 00002000:00010000:2.0:1787847404.885555:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787847399 -> 1787847399 00002000:00010000:2.0:1787847404.885557:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787847401 -> 1787847405 00002000:00010000:2.0:1787847404.885559:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787847404.885761:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595378816:12345-192.168.201.21@tcp:10:bash.0 Request processed in 770us (1112us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787847404.885774:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00002000:00010000:2.0:1787847404.885780:0:6682:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787847404.885783:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6d28f00 with x1874693595378816 ext(0->18446744073709551615) 00002000:00010000:2.0:1787847404.885789:0:6682:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87e6d28f00. 00000100:00100000:0.0:1787847404.959250:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847404.959338:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595378944 00000100:00100000:1.0:1787847404.959351:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595378944 00000100:00100000:0.0:1787847404.959496:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:0.0:1787847404.959508:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:10458:x1874693595378944:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1787847404.959605:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.959638:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.959652:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.959672:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.959680:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.959686:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960128:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960139:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960147:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847404.960397:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960412:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960418:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960435:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960442:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847404.960447:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960455:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960470:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847404.960474:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847404.960479:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960486:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98621df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960501:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960507:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960513:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960519:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847404.960523:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960538:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960547:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c7207e00) 00010000:00010000:0.0:1787847404.960549:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847404.960552:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960559:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98621e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960575:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960581:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960585:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960590:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847404.960591:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960594:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960599:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847404.960600:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847404.960602:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847404.960613:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b98621ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847404.960712:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:10458:x1874693595378944:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1193us (1464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847404.960721:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:0.0:1787847405.011462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.011600:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595379200 00000100:00100000:3.0:1787847405.011616:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595379200 00000100:00100000:3.0:1787847405.011797:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:3.0:1787847405.011812:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:10461:x1874693595379200:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847405.012174:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847405.012417:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98621f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.012523:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.012542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.012556:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.012596:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.012604:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.012610:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.013603:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.013620:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.013629:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847405.013643:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787847405.014165:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014175:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014182:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014188:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.014193:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014215:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014232:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847405.014235:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847405.014240:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014248:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98621fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014266:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014272:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014278:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014283:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.014286:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014300:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014309:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7f100) 00010000:00010000:2.0:1787847405.014312:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847405.014315:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014331:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014396:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98621f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d3b expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014413:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d3b expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.014420:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847405.014423:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787847405.014425:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847405.014604:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:10461:x1874693595379200:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 2794us (3158us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787847405.014616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:0.0:1787847405.018607:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.018720:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595379328 00000100:00100000:3.0:1787847405.018739:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595379328 00000100:00100000:3.0:1787847405.018994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:3.0:1787847405.019012:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:10461:x1874693595379328:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:3.0:1787847405.019105:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.019126:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.019138:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.019181:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.019198:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 30 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847405.019239:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800856940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616371584:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847405.019366:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f333c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787847405.021478:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847405.022431:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800856940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616371584:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847405.022468:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847405.024265:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.024393:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595379584 00000100:00100000:3.0:1787847405.024405:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595379584 00000100:00100000:3.0:1787847405.024480:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:3.0:1787847405.024491:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:5584:x1874693595379584:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787847405.024964:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:5584:x1874693595379584:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 439us (675us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787847405.024974:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:0.0:1787847405.027150:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.027257:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595379712 00000100:00100000:1.0:1787847405.027268:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595379712 00010000:00010000:1.0:1787847405.027327:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 32 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847405.027378:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:1.0:1787847405.027389:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:2347:x1874693595379712:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847405.027410:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847405.027418:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 32 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.027456:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 32 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.027486:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98621bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d26 expref: 32 pid: 5845 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.027507:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847405.027513:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.027524:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.027533:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.027571:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847405.027648:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:2347:x1874693595379712:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 261us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.027657:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00010000:00010000:3.0:1787847405.028223:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028235:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028274:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028283:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028299:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028320:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847405.028326:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028334:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028346:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847405.028349:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847405.028353:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.028360:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847405.028425:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:10461:x1874693595379328:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 9418us (9833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.028435:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:0.0:1787847405.031230:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.031628:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595379968 00000100:00100000:3.0:1787847405.031641:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595379968 00000100:00100000:3.0:1787847405.031720:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1787847405.031732:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:10461:x1874693595379968:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847405.032102:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:10461:x1874693595379968:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 370us (882us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787847405.032110:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:2.0:1787847405.102044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.102145:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595380224 00000100:00100000:0.0:1787847405.102159:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595380224 00000100:00100000:0.0:1787847405.102232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:0.0:1787847405.102245:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:10472:x1874693595380224:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:0.0:1787847405.102298:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847405.102326:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b986221e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d42 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102425:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102442:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102455:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102495:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102502:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102508:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102909:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102920:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.102928:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847405.102993:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1787847405.103108:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103116:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103122:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103129:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847405.103134:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103152:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103167:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847405.103171:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847405.103177:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103184:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103199:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103205:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103210:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103215:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847405.103218:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103224:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103231:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c7207e00) 00010000:00010000:0.0:1787847405.103234:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847405.103236:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986222c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103320:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b986221e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d42 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103335:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d42 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.103343:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847405.103346:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847405.103348:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affa00, rc 0) 00000100:00100000:0.0:1787847405.103439:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:10472:x1874693595380224:12345-192.168.201.21@tcp:101:cat.0 Request processed in 1195us (1409us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787847405.103448:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:2.0:1787847405.109475:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.109573:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595380480 00000100:00100000:3.0:1787847405.109585:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595380480 00000100:00100000:3.0:1787847405.109646:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1787847405.109673:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:10472:x1874693595380480:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:3.0:1787847405.110135:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:10472:x1874693595380480:12345-192.168.201.21@tcp:35:cat.0 Request processed in 462us (675us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787847405.110142:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1787847405.130011:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.130213:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595380736 00000100:00100000:0.0:1787847405.130227:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595380736 00000100:00100000:0.0:1787847405.130312:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:0.0:1787847405.130324:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800856940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:10473:x1874693595380736:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:0.0:1787847405.130406:0:7214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787847405.130442:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d42 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130467:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d3b expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130510:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98621d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d2d expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130521:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847405.130534:0:7214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847405.130562:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130578:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130589:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130604:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130610:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.130616:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.131086:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.131097:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.131105:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787847405.131890:0:7214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787847405.131904:0:7214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319955971383ns, next at 320955968164ns, rc = 0 00010000:00010000:0.0:1787847405.132021:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132034:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132043:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132052:0:7214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132060:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132066:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132479:0:7214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847405.132513:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132522:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132529:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132536:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847405.132553:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132562:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132576:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c7207800) 00010000:00010000:0.0:1787847405.132579:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787847405.132584:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132591:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b986224f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132611:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132617:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132622:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132627:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847405.132629:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132635:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132641:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847405.132645:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847405.132655:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.132660:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862241 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847405.132671:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd2d6041 reply state 0000000098ea1ee4 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847405.132682:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787847405.133419:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800856940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:10473:x1874693595380736:12345-192.168.201.21@tcp:36:rm.0 Request processed in 3086us (3412us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787847405.133432:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 95 00010000:00010000:1.0:1787847405.138142:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.138168:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.138178:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.138202:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847405.138208:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.138217:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.138241:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c7207e00) 00010000:00010000:1.0:1787847405.138244:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847405.138249:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.138256:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.138665:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847405.138675:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.138682:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847405.138686:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.138704:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.138732:0:7621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d87c7207800) 00010000:00010000:2.0:1787847405.138735:0:7621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787847405.138739:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.138745:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862256 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.138761:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847405.138763:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847405.138765:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847405.143446:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616372096:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.143542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847405.143631:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847405.143638:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616371712:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.143672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847405.143698:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616372224:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.143726:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847405.143755:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616371968:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.143780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847405.143799:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787847405.143803:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616371840:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.143826:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847405.143843:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616372352:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.143866:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847405.143895:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616371712 00000100:00100000:3.0:1787847405.143903:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616371712 00000100:00100000:3.0:1787847405.143990:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787847405.144001:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616371712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144059:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616371712:12345-0@lo:400:kworker.0 Request processed in 59us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.144085:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1787847405.144145:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616371712:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144174:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616372224 00000100:00100000:3.0:1787847405.144178:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616372224 00000100:00100000:3.0:1787847405.144214:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616371968 00000100:00100000:3.0:1787847405.144217:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616371968 00000100:00100000:3.0:1787847405.144230:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616371840 00000100:00100000:3.0:1787847405.144232:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616371840 00000100:00100000:3.0:1787847405.144244:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787847405.144250:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616372224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144306:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616372224:12345-0@lo:400:kworker.0 Request processed in 56us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.144312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787847405.144324:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787847405.144330:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616371968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144362:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616371968:12345-0@lo:400:kworker.0 Request processed in 32us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.144367:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787847405.144377:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787847405.144383:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616371840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144408:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616371840:12345-0@lo:400:kworker.0 Request processed in 25us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.144413:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787847405.144439:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616371840:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144450:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616371968:0@lo:400:kworker.0 00000100:00100000:3.0:1787847405.144486:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e00b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616372224:0@lo:400:kworker.0 00000100:00100000:1.0:1787847405.144640:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616372096 00000100:00100000:1.0:1787847405.144645:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616372096 00000100:00100000:1.0:1787847405.144680:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616372352 00000100:00100000:1.0:1787847405.144683:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616372352 00000100:00100000:1.0:1787847405.144711:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787847405.144719:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616372096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847405.144762:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616372096:12345-0@lo:400:kworker.0 Request processed in 44us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.144769:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787847405.144784:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787847405.144790:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616372352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847405.144824:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616372352:12345-0@lo:400:kworker.0 Request processed in 34us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.144841:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787847405.144875:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e00f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616372352:0@lo:400:kworker.0 00000100:00100000:1.0:1787847405.144919:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787847405.144926:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787847405.144985:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87e6d28780, transno 4294967301 00000100:00100000:1.0:1787847405.144998:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616372096:0@lo:400:kworker.0 00000100:00080000:2.0:1787847405.145432:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847405.145438:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847405.145441:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847405.192777:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.193021:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595380992 00000100:00100000:0.0:1787847405.193035:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595380992 00000100:00100000:0.0:1787847405.193113:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:0.0:1787847405.193126:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:10479:x1874693595380992:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847405.193160:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847405.193187:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b986225d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d49 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.193365:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.193383:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.193399:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.193415:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.193436:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.193444:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787847405.194710:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787847405.194988:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195006:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195018:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195064:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195072:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195079:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195086:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847405.195091:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195100:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195128:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847405.195131:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847405.195138:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195144:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862264 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847405.195163:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da870722 reply state 00000000bc69a367 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847405.195174:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787847405.195219:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b986225d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195235:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.195243:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:0.0:1787847405.195246:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847405.195248:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affe00, rc 0) 00000100:00100000:0.0:1787847405.195364:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10479:x1874693595380992:12345-192.168.201.21@tcp:101:bash.0 Request processed in 2239us (2601us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787847405.195374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 96 00010000:00010000:2.0:1787847405.197990:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.198014:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.198023:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.198029:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.198035:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.198044:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.198064:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c7207600) 00010000:00010000:2.0:1787847405.198086:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847405.198093:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.198100:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986226b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847405.201113:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.201253:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595381120 00000100:00100000:1.0:1787847405.201269:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595381120 00000100:00100000:1.0:1787847405.201367:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:1.0:1787847405.201379:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595381120:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1787847405.201404:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847405.201431:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d50 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847405.201469:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847405.201496:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1787847405.201501:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847405.201513:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.201535:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.201553:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4a00, rc 0) 00000100:00100000:1.0:1787847405.201641:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595381120:12345-192.168.201.21@tcp:101:bash.0 Request processed in 264us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.201666:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00080000:2.0:1787847405.201775:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847405.207150:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.207269:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595381248 00000100:00100000:1.0:1787847405.207283:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595381248 00000100:00100000:1.0:1787847405.207388:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1787847405.207400:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:10479:x1874693595381248:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1787847405.207426:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847405.207452:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d57 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.207495:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.207506:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847405.207511:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847405.207517:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.207562:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.207580:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847405.207596:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7920:1874693616372480:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847405.207725:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847405.213916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.214111:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7920:1874693616372480:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847405.214160:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.214189:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5c00, rc 0) 00000100:00100000:1.0:1787847405.214268:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:10479:x1874693595381248:12345-192.168.201.21@tcp:101:bash.0 Request processed in 6870us (7135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.214280:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:2.0:1787847405.214560:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595381376 00000100:00100000:2.0:1787847405.214571:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595381376 00010000:00010000:2.0:1787847405.214617:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.214663:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:2.0:1787847405.214674:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595381376:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847405.214707:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847405.214737:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.214751:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.214781:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d50 expref: 7 pid: 6678 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.214798:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847405.214802:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847405.214821:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.214863:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.214907:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.214925:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1874693616372608:192.168.201.21@tcp:105: 00000100:00100000:2.0:1787847405.215036:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaedf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847405.218540:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdcf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1874693616372608:192.168.201.21@tcp:105: 00010000:00010000:2.0:1787847405.218584:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847405.218679:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595381376:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 4006us (4777us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.218705:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:0.0:1787847405.220044:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.220139:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595381632 00000100:00100000:1.0:1787847405.220151:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595381632 00000100:00100000:1.0:1787847405.220215:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:1.0:1787847405.220229:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:10479:x1874693595381632:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:1.0:1787847405.220732:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10479:x1874693595381632:12345-192.168.201.21@tcp:35:bash.0 Request processed in 505us (696us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1787847405.220742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:0.0:1787847405.366033:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.366173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595381760 00000100:00100000:2.0:1787847405.366189:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595381760 00000100:00100000:2.0:1787847405.366270:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:2.0:1787847405.366292:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:10495:x1874693595381760:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847405.366329:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847405.366358:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986228e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.366448:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.366466:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.366488:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847405.366578:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787847405.366583:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847405.366610:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.366639:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986228e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d5e expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.366662:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d5e expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.366670:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847405.366674:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847405.366678:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152aa00, rc 0) 00000100:00100000:2.0:1787847405.366758:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:10495:x1874693595381760:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 478us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.366766:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:0.0:1787847405.372678:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.372825:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595382016 00000100:00100000:3.0:1787847405.372839:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595382016 00000100:00100000:3.0:1787847405.372956:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:3.0:1787847405.372970:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:10495:x1874693595382016:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847405.373000:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847405.373028:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b986229c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d65 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.373172:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.373191:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.373204:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847405.373218:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787847405.373405:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b986229c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d65 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.373430:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d65 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.373440:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:3.0:1787847405.373461:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847405.373466:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7600, rc 0) 00000100:00100000:3.0:1787847405.373617:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e00b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:10495:x1874693595382016:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 649us (952us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1787847405.373625:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:1.0:1787847405.379063:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.379231:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595382272 00000100:00100000:2.0:1787847405.379245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595382272 00000100:00100000:2.0:1787847405.379329:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:2.0:1787847405.379341:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:10495:x1874693595382272:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847405.379371:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847405.379394:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.379541:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.379560:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.379576:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847405.379592:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787847405.379753:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d6c expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.379772:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d6c expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.379779:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:2.0:1787847405.379782:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787847405.379785:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:2.0:1787847405.379924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:10495:x1874693595382272:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 585us (877us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787847405.379965:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:1.0:1787847405.383390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.383711:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595382400 00000100:00100000:2.0:1787847405.383724:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595382400 00000100:00100000:2.0:1787847405.383820:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1787847405.383834:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:2346:x1874693595382400:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847405.384359:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847405.384443:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d65 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.384465:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:2.0:1787847405.384470:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847405.384550:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:2346:x1874693595382400:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 718us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.384560:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:1.0:1787847405.392429:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.392531:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595382528 00000100:00100000:2.0:1787847405.392545:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595382528 00000100:00100000:2.0:1787847405.392628:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:2.0:1787847405.392640:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2344:x1874693595382528:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:2.0:1787847405.392717:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.392743:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.392752:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847405.392757:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847405.392763:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.392805:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.392821:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 6 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.392858:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874693616372736:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847405.392994:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaede40 going to sleep for 11 seconds 00000100:00100000:3.0:1787847405.399018:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.399184:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdcb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874693616372736:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847405.399235:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847405.399495:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595382656 00000100:00100000:1.0:1787847405.399506:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595382656 00002000:00100000:1.0:1787847405.399577:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d87efa8cf00 x1874693595382656/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:621/0 lens 504/0 e 0 to 0 dl 1787847416 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787847405.399588:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87efa8cf00 with x1874693595382656 ext(0->8) 00010000:00010000:1.0:1787847405.399597:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 7 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.399638:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 7 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847405.399646:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87efa8cf00 00000100:00100000:1.0:1787847405.399689:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:1.0:1787847405.399701:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595382656:12345-192.168.201.21@tcp:4:lfs.0 00000100:00100000:1.0:1787847405.400440:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2346:x1874693595382656:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 734us (1429us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787847405.400450:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00002000:00100000:1.0:1787847405.400459:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d87efa8cf00 x1874693595382656/t4294967302(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:621/0 lens 504/448 e 0 to 0 dl 1787847416 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787847405.400469:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87efa8cf00 with x1874693595382656 ext(0->8) 00010000:00010000:1.0:1787847405.400478:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 9 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.400494:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 9 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847405.400501:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87efa8cf00 00000100:00100000:0.0:1787847405.403662:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.404024:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595382784 00000100:00100000:1.0:1787847405.404038:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595382784 00010000:00010000:1.0:1787847405.404089:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 9 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847405.404157:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:1.0:1787847405.404168:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d14780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2346:x1874693595382784:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847405.404188:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787847405.404215:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787847405.404218:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787847405 00002000:00010000:1.0:1787847405.404220:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787847405 00002000:00010000:1.0:1787847405.404223:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787847405 00010000:00010000:1.0:1787847405.404230:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 9 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.404246:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 9 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.404296:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d57 expref: 9 pid: 7920 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.404319:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847405.404325:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847405.404332:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.404345:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.404391:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847405.404475:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d14780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595382784:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 308us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.404483:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00010000:00010000:3.0:1787847405.405200:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405215:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405251:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405261:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405289:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405298:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847405.405304:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405313:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405346:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.405354:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b98622c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847405.405446:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2344:x1874693595382528:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 12806us (13032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.405456:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:0.0:1787847405.408799:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.408914:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595383040 00000100:00100000:1.0:1787847405.408927:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595383040 00000100:00100000:1.0:1787847405.409031:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1787847405.409043:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:10495:x1874693595383040:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:1.0:1787847405.409134:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d6c expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847405.409477:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787847405.409522:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787847405.409983:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787847405.410054:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.410074:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.410084:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.410127:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.410147:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 43 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847405.410166:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874693616372864:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847405.410306:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847405.413762:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.414066:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595383168 00000100:00100000:3.0:1787847405.414077:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595383168 00010000:00010000:3.0:1787847405.414135:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847405.414188:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1787847405.414200:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+44:2347:x1874693595383168:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847405.414222:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847405.414231:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.414248:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 44 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.414416:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:3.0:1787847405.414424:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.414454:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.414463:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.414493:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847405.414570:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+44:2347:x1874693595383168:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 371us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.414580:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00010000:00010000:1.0:1787847405.414747:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9862272 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d49 expref: 43 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847405.414767:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874693616372864:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847405.414795:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.414805:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.415044:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847405.415214:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787847405.415601:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787847405.417214:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616372992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787847405.417490:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847405.417580:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847405.417637:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616372992 00000100:00100000:0.0:1787847405.417646:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616372992 00000100:00100000:0.0:1787847405.417958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787847405.417972:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616372992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787847405.418146:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616372992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 178us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847405.418156:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847405.418426:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616372992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787847405.420122:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787847405.420244:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616373120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787847405.420419:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847405.420494:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847405.420551:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616373120 00000100:00100000:1.0:1787847405.420559:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616373120 00000100:00100000:1.0:1787847405.420786:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847405.420816:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616373120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787847405.421232:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1874693616373120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 431us (813us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787847405.421240:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787847405.421380:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdcb40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616373120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787847405.421476:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787847405.421530:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.421544:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.421552:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.421559:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.421564:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.421572:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.421604:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:2.0:1787847405.421608:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787847405.421614:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.421621:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98622cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787847405.422348:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787847405.422472:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787847405.422485:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 320246552671ns, next at 321246550374ns, rc = 0 00000001:00080000:2.0:1787847405.422494:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787847405.422536:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c7207b00) 00010000:00010000:2.0:1787847405.422541:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787847405.422551:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d6c expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.422706:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:10495:x1874693595383040:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 13665us (13921us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787847405.422742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000020:00080000:2.0:1787847405.422749:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787847405.426126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.426312:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595383296 00000100:00100000:3.0:1787847405.426325:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595383296 00000100:00100000:3.0:1787847405.426397:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:3.0:1787847405.426409:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:10495:x1874693595383296:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847405.426441:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847405.426473:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98622d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d73 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.426554:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98622d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d73 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.426571:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98622d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d73 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.426594:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847405.426597:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847405.426621:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6400, rc 0) 00000100:00100000:3.0:1787847405.426715:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:10495:x1874693595383296:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 308us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.426722:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:0.0:1787847405.430073:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.430299:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595383552 00000100:00100000:3.0:1787847405.430311:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595383552 00000100:00100000:3.0:1787847405.430415:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:3.0:1787847405.430427:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:10495:x1874693595383552:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847405.430749:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:10495:x1874693595383552:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 323us (689us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1787847405.430758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:1.0:1787847405.542490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.542759:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595383680 00000100:00100000:2.0:1787847405.542773:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595383680 00000100:00100000:2.0:1787847405.542871:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:2.0:1787847405.542884:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:10505:x1874693595383680:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:2.0:1787847405.543039:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543087:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543102:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543121:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543128:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543133:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543270:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543289:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543298:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847405.543351:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543366:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543373:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543391:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543397:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.543402:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543410:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543424:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847405.543427:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847405.543432:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543438:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b98622db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543454:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543461:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543465:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543470:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.543473:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543488:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543497:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7f100) 00010000:00010000:2.0:1787847405.543499:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847405.543502:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543508:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98622e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543524:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543531:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543537:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543543:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.543546:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543551:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543558:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847405.543560:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847405.543563:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.543577:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98622e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.543687:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:10505:x1874693595383680:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 804us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.543698:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:0.0:1787847405.594091:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.594607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595383936 00000100:00100000:3.0:1787847405.594621:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595383936 00000100:00100000:3.0:1787847405.595641:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:3.0:1787847405.595664:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:10508:x1874693595383936:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847405.595947:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847405.595977:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98622f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d7a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596084:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596103:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596116:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596135:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596167:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596174:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596352:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b9862305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596361:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b9862305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596368:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b9862305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847405.596379:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787847405.596509:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596517:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596524:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596531:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847405.596535:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596542:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596565:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847405.596569:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847405.596573:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596580:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98622f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596596:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596601:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596607:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596613:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847405.596616:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596631:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596638:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c3361a00) 00010000:00010000:3.0:1787847405.596640:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847405.596643:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596649:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98622fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596714:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98622f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d7a expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596728:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b9862305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d7a expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.596736:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847405.596738:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847405.596741:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165cc00, rc 0) 00000100:00100000:3.0:1787847405.596834:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10508:x1874693595383936:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1178us (2757us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787847405.596843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:3.0:1787847405.602693:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.602825:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595384064 00000100:00100000:2.0:1787847405.602839:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595384064 00000100:00100000:2.0:1787847405.602908:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:2.0:1787847405.602921:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10508:x1874693595384064:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:2.0:1787847405.603355:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603374:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603386:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603417:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603425:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603432:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603439:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847405.603443:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603466:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603490:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847405.603493:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847405.603499:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.603507:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862313 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.603600:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10508:x1874693595384064:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 682us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.603607:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:1.0:1787847405.607849:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.607983:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595384320 00000100:00100000:2.0:1787847405.608005:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595384320 00000100:00100000:2.0:1787847405.608354:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:2.0:1787847405.608367:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:10508:x1874693595384320:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1787847405.609484:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:10508:x1874693595384320:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 1113us (1643us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787847405.609499:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:3.0:1787847405.665286:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847405.665320:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616373248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847405.665416:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847405.665613:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616373248 00000100:00100000:2.0:1787847405.665624:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616373248 00000100:00100000:2.0:1787847405.665699:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787847405.665711:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616373248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847405.665759:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847405.665820:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616373248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.665848:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787847405.665911:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616373248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847405.751117:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.751392:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595384576 00000100:00100000:3.0:1787847405.751405:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595384576 00000100:00100000:3.0:1787847405.751489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:3.0:1787847405.751503:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:10518:x1874693595384576:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847405.751538:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847405.751542:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787847405.751577:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d5e expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.751594:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847405.751615:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847405.751635:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986231a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d81 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.751914:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.752034:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.752049:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847405.752063:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787847405.752308:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986231a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d81 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.752327:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d81 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.752336:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847405.752339:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847405.752342:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c400, rc 0) 00000100:00100000:3.0:1787847405.752422:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10518:x1874693595384576:12345-192.168.201.21@tcp:101:bash.0 Request processed in 922us (1319us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787847405.752431:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:0.0:1787847405.761258:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.761376:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595384832 00000100:00100000:2.0:1787847405.761389:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595384832 00000100:00100000:2.0:1787847405.761463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:2.0:1787847405.761483:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10518:x1874693595384832:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:2.0:1787847405.761554:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787847405.761589:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d81 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.761608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b9862305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d7a expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.761616:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847405.761620:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847405.761874:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.761889:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.761901:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787847405.762029:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787847405.762056:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd8bc7cb reply state 00000000bca86675 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.762083:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847405.762199:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10518:x1874693595384832:12345-192.168.201.21@tcp:36:bash.0 Request processed in 725us (957us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787847405.762207:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 105 00000020:00080000:2.0:1787847405.762214:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787847405.765908:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.766291:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.766303:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.766309:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847405.766315:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.766324:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.766373:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:0.0:1787847405.766377:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847405.766383:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.766390:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986232f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847405.773507:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.773760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595384960 00000100:00100000:3.0:1787847405.773773:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595384960 00000100:00100000:3.0:1787847405.773849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 106 00000100:00100000:3.0:1787847405.773863:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:10518:x1874693595384960:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847405.773913:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847405.773978:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d88 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.774099:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.774116:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.774128:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847405.774165:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787847405.774170:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847405.774331:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.774362:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.774379:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.774386:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847405.774388:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847405.774392:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165dc00, rc 0) 00000100:00100000:3.0:1787847405.774462:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10518:x1874693595384960:12345-192.168.201.21@tcp:101:bash.0 Request processed in 604us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.774470:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 106 00000100:00100000:1.0:1787847405.783500:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.784626:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595385216 00000100:00100000:3.0:1787847405.784643:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595385216 00000100:00100000:3.0:1787847405.784735:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:3.0:1787847405.784747:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:10518:x1874693595385216:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:3.0:1787847405.785635:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10518:x1874693595385216:12345-192.168.201.21@tcp:35:bash.0 Request processed in 885us (2143us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787847405.785647:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1787847405.880348:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.880459:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595385344 00000100:00100000:2.0:1787847405.880472:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595385344 00000100:00100000:2.0:1787847405.880550:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 107 00000100:00100000:2.0:1787847405.880561:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:10524:x1874693595385344:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847405.880594:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847405.880622:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862344 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d8f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.880709:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986234b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.880725:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986234b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.880737:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986234b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847405.880825:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787847405.880830:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847405.880860:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986234b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.880891:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862344 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d8f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.880970:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986234b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d8f expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.880981:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:2.0:1787847405.880985:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847405.880990:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:2.0:1787847405.881068:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d14f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595385344:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 508us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.881077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 107 00000100:00100000:0.0:1787847405.885820:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847405.885924:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595385472 00000100:00100000:3.0:1787847405.886068:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595385472 00000100:00100000:3.0:1787847405.886217:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 108 00000100:00100000:3.0:1787847405.886231:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595385472:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847405.886260:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847405.886297:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d96 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886385:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886405:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886420:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886437:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886445:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886744:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886873:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886882:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.886890:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847405.886958:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787847405.886964:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847405.886989:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887004:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887013:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887021:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887029:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887035:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847405.887040:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887057:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887071:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847405.887074:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847405.887079:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887086:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862359 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887102:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887109:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887115:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887120:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847405.887122:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887128:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887135:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c3361a00) 00010000:00010000:3.0:1787847405.887137:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847405.887140:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887156:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887197:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d96 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887213:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d96 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847405.887220:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847405.887223:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847405.887226:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:3.0:1787847405.887323:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d15680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10524:x1874693595385472:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1095us (1520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847405.887331:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 108 00000100:00100000:1.0:1787847405.897142:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847405.897197:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.897300:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595385856 00000100:00100000:0.0:1787847405.897312:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595385856 00000100:00100000:0.0:1787847405.897399:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:0.0:1787847405.897411:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:2346:x1874693595385856:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847405.897435:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847405.897467:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d96 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.897505:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:0.0:1787847405.897512:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847405.897585:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:2346:x1874693595385856:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 175us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847405.897593:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1787847405.897847:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595385728 00000100:00100000:2.0:1787847405.897853:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595385728 00000100:00100000:2.0:1787847405.897894:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 109 00000100:00100000:2.0:1787847405.897903:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595385728:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847405.897924:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847405.898221:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986236e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0d9d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.898358:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.898376:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.898385:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.898428:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.898461:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 56 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.898544:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616373376:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847405.898641:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847405.902237:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616373376:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847405.902285:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847405.905304:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847405.905382:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595385984 00000100:00100000:2.0:1787847405.905395:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595385984 00010000:00010000:2.0:1787847405.905454:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 57 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847405.905512:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:2.0:1787847405.905523:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:2346:x1874693595385984:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847405.905547:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847405.905556:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 57 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.905571:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 57 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.905598:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986233d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d88 expref: 57 pid: 5844 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.905642:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847405.905650:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.905661:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.905670:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847405.905775:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847405.905860:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:2346:x1874693595385984:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 337us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847405.905869:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00010000:00010000:0.0:1787847405.906617:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.906629:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847405.906666:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787847405.906863:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986236e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.906885:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.906894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:0.0:1787847405.906897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787847405.906900:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152aa00, rc 0) 00000100:00100000:0.0:1787847405.907231:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10524:x1874693595385728:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 9327us (10102us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787847405.907242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 109 00000100:00100000:3.0:1787847405.911149:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.911263:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595386240 00000100:00100000:0.0:1787847405.911286:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595386240 00000100:00100000:0.0:1787847405.911621:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:0.0:1787847405.911633:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10524:x1874693595386240:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:0.0:1787847405.911653:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847405.913385:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98622d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d73 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.913416:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:0.0:1787847405.913423:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847405.913516:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595386240:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 1885us (2382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847405.913527:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1787847405.915817:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.916083:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595386368 00000100:00100000:0.0:1787847405.916094:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595386368 00000100:00100000:0.0:1787847405.916569:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00100000:0.0:1787847405.916584:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595386368:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:0.0:1787847405.916752:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.916770:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847405.916782:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787847405.917063:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787847405.917181:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595386368:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 601us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847405.917188:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00100000:1.0:1787847405.920647:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847405.920815:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595386496 00000100:00100000:0.0:1787847405.920828:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595386496 00000100:00100000:0.0:1787847405.920912:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 111 00000100:00100000:0.0:1787847405.920925:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:10524:x1874693595386496:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847405.921700:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847405.921735:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0da4 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.921817:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.921831:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 56 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.921857:0:7214:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.921871:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 56 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.921885:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:1.0:1787847405.921887:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787847405.921890:0:7214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 56 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847405.921897:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4a00, rc 0) 00000100:00100000:1.0:1787847405.922041:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10524:x1874693595386496:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1118us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847405.922062:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 111 00010000:00010000:1.0:1787847406.039360:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787847406.488103:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787847406.488115:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787847406.488174:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787847406.488181:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787847406.488528:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616373504:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787847406.488687:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7840 going to sleep for 11 seconds 00000100:00100000:2.0:1787847406.495441:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616373504:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787847406.495635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847406.495896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595386624 00000100:00100000:3.0:1787847406.495907:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595386624 00000100:00100000:3.0:1787847406.496049:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:3.0:1787847406.496062:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10525:x1874693595386624:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787847406.496106:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1787847406.496587:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847406.497377:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10525:x1874693595386624:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 1308us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847406.497404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 112 00000100:00100000:1.0:1787847406.502237:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.502405:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595386752 00000100:00100000:2.0:1787847406.502419:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595386752 00000100:00100000:2.0:1787847406.502497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:2.0:1787847406.502510:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10525:x1874693595386752:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787847406.502636:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.502659:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.502677:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506733:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506759:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506773:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506815:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506825:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506832:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847406.506889:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787847406.506894:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847406.506909:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506922:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506963:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506970:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506976:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847406.506980:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.506987:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507000:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:2.0:1787847406.507003:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847406.507007:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507013:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862391 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507029:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507034:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507040:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847406.507054:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507060:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507066:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d87c4d7f100) 00010000:00010000:2.0:1787847406.507069:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847406.507071:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507076:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862398 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507090:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507095:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507100:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507104:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847406.507106:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507111:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507117:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847406.507119:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847406.507129:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.507135:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986239f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.509616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10525:x1874693595386752:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 7095us (7380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.509631:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 113 00000100:00100000:0.0:1787847406.515127:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.515227:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595387008 00000100:00100000:1.0:1787847406.515249:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595387008 00000100:00100000:1.0:1787847406.515320:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:1.0:1787847406.515330:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:10525:x1874693595387008:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.515353:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847406.515374:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dab expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515471:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515487:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515499:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847406.515510:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787847406.515610:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515619:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515626:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515652:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847406.515657:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515665:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515806:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:1.0:1787847406.515809:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787847406.515814:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515821:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515865:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623a6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dab expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515876:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:1.0:1787847406.515878:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787847406.515882:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dab expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.515892:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4200, rc 0) 00000100:00100000:1.0:1787847406.516119:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10525:x1874693595387008:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 789us (1001us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1787847406.516127:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:0.0:1787847406.522044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.522298:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595387136 00000100:00100000:1.0:1787847406.522324:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595387136 00000100:00100000:1.0:1787847406.522386:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:1.0:1787847406.522396:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10525:x1874693595387136:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787847406.522432:0:7214:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787847406.522730:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10525:x1874693595387136:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 333us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.522738:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 115 00000100:00100000:0.0:1787847406.536579:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847406.538561:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595387392 00000100:00100000:3.0:1787847406.538700:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595387392 00000100:00100000:3.0:1787847406.538773:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:3.0:1787847406.538784:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10525:x1874693595387392:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847406.538807:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847406.538809:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787847406.538837:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986234b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d8f expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.538856:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847406.538861:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847406.538876:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98623bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0db2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787847406.539390:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787847406.539579:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98623c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.539605:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98623c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.539616:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98623c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.539667:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98623bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db2 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.539686:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98623c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db2 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.539708:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:3.0:1787847406.539711:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847406.539713:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c200, rc 0) 00000100:00100000:3.0:1787847406.539790:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10525:x1874693595387392:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1003us (3217us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787847406.539798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 116 00000100:00100000:3.0:1787847406.544042:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847406.544398:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595387648 00000100:00100000:0.0:1787847406.544408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595387648 00000100:00100000:0.0:1787847406.544469:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:0.0:1787847406.544480:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10525:x1874693595387648:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787847406.544557:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847406.544586:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98623c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db2 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544605:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:0.0:1787847406.544616:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847406.544642:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544655:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544663:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544688:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544696:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544703:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544779:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544798:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544805:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544816:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847406.544821:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544828:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544838:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:0.0:1787847406.544841:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847406.544844:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544849:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98623d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544870:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544876:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544882:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544887:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847406.544890:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544896:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544915:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9dca481d (ffff8d87c7207a00) 00010000:00010000:0.0:1787847406.544918:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847406.544921:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.544927:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98623d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9dca481d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847406.545398:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10525:x1874693595387648:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 918us (1363us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787847406.545406:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 117 00000100:00100000:0.0:1787847406.548991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.549165:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595387776 00000100:00100000:1.0:1787847406.549175:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595387776 00000100:00100000:1.0:1787847406.549235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:1.0:1787847406.549246:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:10525:x1874693595387776:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.549275:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847406.549298:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0db9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.549332:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.549342:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.549351:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.549455:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.549472:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.549493:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:1.0:1787847406.549496:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787847406.549499:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5a00, rc 0) 00000100:00100000:1.0:1787847406.549582:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d17840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10525:x1874693595387776:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 339us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.549589:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:0.0:1787847406.555280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.555549:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595388032 00000100:00100000:1.0:1787847406.555559:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595388032 00000100:00100000:1.0:1787847406.555616:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:1.0:1787847406.555626:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:10525:x1874693595388032:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.555725:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.555742:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.555755:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787847406.556118:0:7214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1787847406.556129:0:7214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321380196178ns, next at 322380193852ns, rc = 0 00000004:00010000:1.0:1787847406.556220:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009424c03f reply state 00000000ce5890a6 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.556230:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787847406.556379:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:10525:x1874693595388032:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 753us (1121us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787847406.556403:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 119 00000100:00100000:0.0:1787847406.559598:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:2.0:1787847406.559866:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.559878:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.559886:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.559892:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847406.559897:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.559906:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.559923:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:2.0:1787847406.559926:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787847406.559964:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.559971:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98623ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.560319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595388160 00000100:00100000:1.0:1787847406.560329:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595388160 00000100:00100000:1.0:1787847406.560387:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:1.0:1787847406.560397:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:10525:x1874693595388160:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.560423:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847406.560443:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dc0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.560500:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.560513:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.560530:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:1.0:1787847406.560533:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787847406.560535:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4400, rc 0) 00000100:00100000:1.0:1787847406.560589:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d16580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:10525:x1874693595388160:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 193us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.560596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:0.0:1787847406.563404:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847406.563497:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595388288 00000100:00100000:3.0:1787847406.563506:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595388288 00000100:00100000:3.0:1787847406.563577:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1787847406.563588:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595388288:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787847406.563921:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2346:x1874693595388288:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 334us (525us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787847406.563961:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00080000:2.0:1787847406.564039:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847406.572047:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.572132:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595388544 00000100:00100000:2.0:1787847406.572141:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595388544 00000100:00100000:2.0:1787847406.572200:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:2.0:1787847406.572211:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:10525:x1874693595388544:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787847406.572545:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:10525:x1874693595388544:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 336us (509us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787847406.572551:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:0.0:1787847406.576702:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.577089:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595388800 00000100:00100000:2.0:1787847406.577099:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595388800 00000100:00100000:2.0:1787847406.577159:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:2.0:1787847406.577169:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:10525:x1874693595388800:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787847406.577291:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:10525:x1874693595388800:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 123us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.577300:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 121 00000100:00100000:0.0:1787847406.581075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.581307:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595388928 00000100:00100000:1.0:1787847406.581317:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595388928 00000100:00100000:1.0:1787847406.581444:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:1.0:1787847406.581452:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:10525:x1874693595388928:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.581472:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847406.581504:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98623fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dc7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.581565:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.581576:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.581585:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847406.581626:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787847406.581645:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.581736:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98623fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc7 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.581759:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc7 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.581767:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:1.0:1787847406.581769:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787847406.581772:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5200, rc 0) 00000100:00100000:1.0:1787847406.581913:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:10525:x1874693595388928:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 461us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.581919:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:0.0:1787847406.589463:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.589546:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389056 00000100:00100000:1.0:1787847406.589556:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389056 00000100:00100000:1.0:1787847406.589631:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:1.0:1787847406.589641:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2347:x1874693595389056:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.589659:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847406.589693:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dce expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847406.589724:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9062ef, blocks: 0x1 00010000:00010000:1.0:1787847406.589746:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1787847406.589751:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847406.589761:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 10 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.589781:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 10 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.590071:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4000, rc 0) 00000100:00100000:1.0:1787847406.590126:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595389056:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 486us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.590134:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1787847406.595635:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.595727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389312 00000100:00100000:2.0:1787847406.595737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389312 00000100:00100000:2.0:1787847406.595809:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:2.0:1787847406.595819:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:10525:x1874693595389312:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787847406.595964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:10525:x1874693595389312:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 114us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.595974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 123 00000100:00100000:0.0:1787847406.602515:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847406.602692:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389440 00000100:00100000:3.0:1787847406.602702:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389440 00000100:00100000:3.0:1787847406.602766:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:3.0:1787847406.602776:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:10525:x1874693595389440:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847406.602803:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847406.602822:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dd5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.602854:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.602881:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847406.602886:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847406.602893:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.602928:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 11 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.602981:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 11 pid: 6679 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847406.602997:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616373632:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847406.603085:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847406.611269:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.611389:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389568 00000100:00100000:1.0:1787847406.611399:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389568 00010000:00010000:1.0:1787847406.611440:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 12 pid: 6679 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.611486:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:1.0:1787847406.611496:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:2347:x1874693595389568:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847406.611525:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847406.611549:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 12 pid: 6679 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.611563:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 12 pid: 6679 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.611591:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847406.611596:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847406.611605:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.611615:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.611652:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.611974:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1874693616373760:192.168.201.21@tcp:105: 00000100:00100000:1.0:1787847406.612052:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787847406.613046:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017971d8f/0x1835de88b9862408 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dce expref: 12 pid: 6679 timeout: 421 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847406.613067:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8c3c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616373632:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847406.613092:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.613106:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:3.0:1787847406.613156:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:10525:x1874693595389440:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 10381us (10653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847406.613180:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:0.0:1787847406.625659:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.625828:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9cf00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5828:1874693616373760:192.168.201.21@tcp:105: 00010000:00010000:1.0:1787847406.625853:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847406.625911:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595389568:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 14416us (14659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.625924:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:2.0:1787847406.626136:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389696 00000100:00100000:2.0:1787847406.626143:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389696 00002000:00100000:2.0:1787847406.626194:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d8800517840 x1874693595389696/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:622/0 lens 504/0 e 0 to 0 dl 1787847417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847406.626205:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d8800517840 with x1874693595389696 ext(0->12) 00002000:00010000:2.0:1787847406.626210:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d8800517840 00000100:00100000:2.0:1787847406.626239:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1787847406.626248:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595389696:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787847406.626865:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:2347:x1874693595389696:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 533us (1131us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787847406.626876:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00002000:00100000:2.0:1787847406.626884:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d8800517840 x1874693595389696/t4294967308(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:622/0 lens 504/448 e 0 to 0 dl 1787847417 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847406.626893:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d8800517840 with x1874693595389696 ext(0->12) 00002000:00010000:2.0:1787847406.626897:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d8800517840 00000100:00100000:0.0:1787847406.630603:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.630708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389824 00000100:00100000:1.0:1787847406.630717:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389824 00000100:00100000:1.0:1787847406.630780:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:1.0:1787847406.630801:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:10525:x1874693595389824:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787847406.685200:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:3.0:1787847406.685214:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1787847406.685236:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1787847406.685239:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787847406.685277:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1787847406.685289:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787847406.685306:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787847406.685319:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d87e6f33d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787847406.685323:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d87e6f33840 00000020:00080000:3.0:1787847406.685327:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87c503f000 00000020:00080000:1.0:1787847406.685461:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1787847406.685470:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787847406.685587:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616373888:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787847406.685650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847406.685711:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616373888 00000100:00100000:1.0:1787847406.685718:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616373888 00000100:00100000:1.0:1787847406.685757:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787847406.685765:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616373888:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787847406.685896:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787847406.685927:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9062ed, atime: 0x6a9062ed, ctime: 0x6a9062ed, blocks: 0x1 00010000:00010000:1.0:1787847406.685954:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.685972:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=321s v=(0 0) 00010000:00010000:1.0:1787847406.685977:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847406.685984:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.686000:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.686010:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.686036:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.686056:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787847406.686715:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1874693616373888:12345-0@lo:6:osp-syn-0-0.0 Request processed in 949us (1062us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787847406.686725:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1787847406.686777:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87f7f9cf00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1787847406.686784:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616373888:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787847406.687006:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616374016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787847406.687041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847406.687080:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847406.687097:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616374144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787847406.687121:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847406.687150:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616374016 00000100:00100000:0.0:1787847406.687154:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616374016 00000100:00100000:0.0:1787847406.687193:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616374144 00000100:00100000:0.0:1787847406.687196:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616374144 00000100:00100000:0.0:1787847406.687207:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787847406.687214:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616374016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787847406.687232:0:6677:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1787847406.687248:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.687274:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.687283:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787847406.687286:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787847406.687291:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.687315:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.687329:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 11 pid: 6679 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847406.687340:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800515e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616374272:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847406.687551:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787847406.687560:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1874693616374144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787847406.687679:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787847406.687682:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787847407 00002000:00010000:1.0:1787847406.687684:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787847406.687686:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787847407 -> 1787847407 00002000:00010000:1.0:1787847406.687689:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787847406.687727:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3303:x1874693616374144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (603us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787847406.687733:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787847406.687858:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f15c9f00 going to sleep for 11 seconds 00000004:00080000:0.0:1787847406.687888:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d88005161c0/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787847406.687893:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616374144:0@lo:2:osp-syn-1-0.0 00000020:00080000:3.0:1787847406.691451:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d87e6f33780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787847406.691463:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d87e6f33180 00000020:00080000:3.0:1787847406.691466:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87e6c44c00 00000020:00080000:1.0:1787847406.692008:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787847406.692216:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787847406.692482:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.693078:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595389952 00000100:00100000:1.0:1787847406.693088:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595389952 00010000:00010000:1.0:1787847406.693126:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 12 pid: 6679 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.693198:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:1.0:1787847406.693208:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:2347:x1874693595389952:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847406.693224:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847406.693230:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 12 pid: 6679 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.693245:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 12 pid: 6679 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.693280:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847406.693285:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847406.693292:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.693301:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.693320:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847406.693370:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:2347:x1874693595389952:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 163us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.693379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00010000:00010000:3.0:1787847406.695374:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98621d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d34 expref: 11 pid: 6679 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847406.695397:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800515e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616374272:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847406.695421:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.695433:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.695460:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.695470:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.695479:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.695494:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1787847406.696292:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3301:x1874693616374016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9074us (9246us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787847406.696304:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1787847406.696400:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787847406.696409:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696433:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5c00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847406.696437:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696447:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696467:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696475:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e259de29/0x1835de88b9862416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696494:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847406.696498:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696505:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847406.696508:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696516:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696527:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696541:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b986241d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.696556:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847406.696558:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847406.696560:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787847406.696730:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d8800516580/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787847406.696738:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800516580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616374016:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787847406.697019:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847406.697159:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10525:x1874693595389824:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 66368us (66563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.697169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 124 00000100:00100000:0.0:1787847406.704446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.704525:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595390080 00000100:00100000:1.0:1787847406.704534:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595390080 00000100:00100000:1.0:1787847406.704591:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:1.0:1787847406.704602:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:2347:x1874693595390080:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787847406.753340:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787847406.753457:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787847406.753471:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1787847406.753646:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595390080:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 49041us (49204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.753659:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:0.0:1787847406.759719:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.760411:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595390336 00000100:00100000:2.0:1787847406.760423:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595390336 00000100:00100000:2.0:1787847406.760527:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 125 00000100:00100000:2.0:1787847406.760538:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10525:x1874693595390336:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787847406.760611:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847406.760638:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc7 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.760657:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:2.0:1787847406.760671:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847406.760703:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.760718:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.760727:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847406.761020:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e62e81c6 reply state 000000006e8ed8a8 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.761031:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847406.761145:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:10525:x1874693595390336:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 608us (1435us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1787847406.761153:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 125 00010000:00010000:3.0:1787847406.764446:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.764463:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.764471:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.764477:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847406.764482:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.764504:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.764521:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:3.0:1787847406.764525:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847406.764529:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.764536:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862424 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847406.766092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847406.766305:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595390464 00000100:00100000:3.0:1787847406.766315:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595390464 00000100:00100000:3.0:1787847406.766383:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1787847406.766393:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595390464:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787847406.766645:0:7920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787847406.766649:0:7920:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787847407 -> 1787847406 00002000:00010000:3.0:1787847406.766651:0:7920:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787847405 00002000:00010000:3.0:1787847406.766654:0:7920:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787847407 -> 1787847406 00002000:00010000:3.0:1787847406.766656:0:7920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787847406.766724:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595390464:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 332us (640us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787847406.766732:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:0.0:1787847406.770231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847406.770320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595390720 00000100:00100000:3.0:1787847406.770331:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595390720 00000100:00100000:3.0:1787847406.770404:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:3.0:1787847406.770414:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10525:x1874693595390720:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787847406.770506:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.770523:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.770532:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.770568:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.770581:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 15 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847406.770596:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616374400:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847406.770695:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847406.774112:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616374400:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847406.774147:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847406.780302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.780653:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595390848 00000100:00100000:2.0:1787847406.780672:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595390848 00010000:00010000:2.0:1787847406.780713:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.780755:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:2.0:1787847406.780765:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:2347:x1874693595390848:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847406.780798:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847406.780806:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.780819:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.780841:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98623e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0db9 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.780858:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:2.0:1787847406.780863:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.780873:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.780880:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.780912:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847406.781100:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781109:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781138:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781146:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781153:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781167:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847406.781172:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781179:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:0.0:1787847406.781191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787847406.781195:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.781201:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986242b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847406.781286:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:10525:x1874693595390720:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 10871us (11062us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787847406.781295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 126 00000100:00100000:2.0:1787847406.782019:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:2347:x1874693595390848:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 1251us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.782029:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:0.0:1787847406.787388:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.787611:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595390976 00000100:00100000:1.0:1787847406.787623:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595390976 00000100:00100000:1.0:1787847406.787692:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1787847406.787701:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595390976:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.787746:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.787766:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.787775:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847406.787779:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847406.787795:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.787849:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.787862:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 7 pid: 6677 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.787878:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874693616374528:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847406.787993:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847406.791613:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.791772:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595391104 00000100:00100000:2.0:1787847406.791782:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595391104 00010000:00010000:2.0:1787847406.791829:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 8 pid: 6677 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.791907:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:2.0:1787847406.791917:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595391104:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847406.791969:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847406.791995:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 8 pid: 6677 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.792008:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 8 pid: 6677 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.792034:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847406.792038:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847406.792045:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.792055:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.792077:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847406.792130:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595391104:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 214us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.792138:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00010000:00010000:1.0:1787847406.792306:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1690360/0x1835de88b986240f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dd5 expref: 7 pid: 6677 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.792322:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874693616374528:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847406.792341:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792352:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792358:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792383:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792403:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792411:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792419:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5c00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847406.792423:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792432:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792445:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.792452:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862432 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.792498:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595390976:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 4799us (5121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.792506:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:3.0:1787847406.795621:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.795763:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595391360 00000100:00100000:1.0:1787847406.795774:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595391360 00000100:00100000:1.0:1787847406.795846:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 127 00000100:00100000:1.0:1787847406.795887:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10525:x1874693595391360:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787847406.796010:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796029:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796042:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796284:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796297:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796306:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796343:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.796358:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 15 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.796375:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616374656:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847406.796471:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847406.800498:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.800595:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595391488 00000100:00100000:2.0:1787847406.800605:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595391488 00010000:00010000:2.0:1787847406.800646:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.800717:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:2.0:1787847406.800727:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:2346:x1874693595391488:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847406.800743:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847406.800750:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.800764:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 16 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.800787:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:2.0:1787847406.800792:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.800801:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.800808:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.800828:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847406.800898:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:2346:x1874693595391488:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 171us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.800906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00010000:00010000:1.0:1787847406.801154:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98623f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dc0 expref: 15 pid: 5845 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.801184:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616374656:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847406.801204:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.801212:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.801217:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847406.801420:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787847406.801571:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787847406.801619:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787847406.801712:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616374784:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787847406.801761:0:7214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847406.801803:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e780 going to sleep for 11 seconds 00000100:00100000:2.0:1787847406.802472:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616374784 00000100:00100000:2.0:1787847406.802478:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616374784 00000100:00100000:2.0:1787847406.802528:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787847406.802536:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7214:x1874693616374784:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787847406.802640:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7214:x1874693616374784:12345-0@lo:1000:mdt00_003.0 Request processed in 104us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.802647:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787847406.802893:0:7214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787847406.802900:0:7214:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:3.0:1787847406.802923:0:7214:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d88005161c0, transno 4294967309 00000004:00080000:3.0:1787847406.802963:0:7214:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d8800516580, transno 4294967310 00000100:00100000:3.0:1787847406.802971:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616374784:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787847406.803431:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1787847406.803503:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616374912:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787847406.803555:0:7214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847406.803577:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847406.804390:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616374912 00000100:00100000:2.0:1787847406.804400:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616374912 00000100:00100000:2.0:1787847406.804439:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847406.804448:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7214:x1874693616374912:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787847406.804635:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7214:x1874693616374912:12345-0@lo:1000:mdt00_003.0 Request processed in 187us (1079us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787847406.804644:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787847406.805336:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8c780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616374912:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787847406.805377:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805387:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805394:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805401:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847406.805405:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805413:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805429:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122ea00) 00010000:00010000:3.0:1787847406.805432:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847406.805437:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805444:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b9862440 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805477:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805484:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805503:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805507:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847406.805510:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805515:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805524:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847406.805526:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847406.805533:0:7214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 18 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805542:0:7214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 18 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805550:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 18 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.805582:0:7214:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 18 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847406.805596:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9c74b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616375040:192.168.201.21@tcp:105: 00000100:00100000:3.0:1787847406.806290:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847406.808767:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9c74b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616375040:192.168.201.21@tcp:105: 00010000:00010000:1.0:1787847406.808803:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808813:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862383 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808842:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808855:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808879:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808889:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808895:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808902:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808907:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5c00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847406.808911:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808917:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808928:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:1.0:1787847406.808963:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847406.808967:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808973:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862447 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808983:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.808989:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.809000:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.809005:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847406.809008:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.809014:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.809021:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:1.0:1787847406.809024:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787847406.809027:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.809033:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862439 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847406.809229:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:10525:x1874693595391360:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 13344us (13616us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1787847406.809239:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 127 00000020:00080000:1.0:1787847406.809244:0:7214:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787847406.809751:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787847406.809756:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787847406.810359:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787847406.810369:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787847406.814097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.814132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847406.814189:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595391616 00000100:00100000:1.0:1787847406.814199:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595391616 00000100:00100000:1.0:1787847406.814239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595391872 00000100:00100000:1.0:1787847406.814241:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595391872 00000100:00100000:1.0:1787847406.814252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:1.0:1787847406.814270:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:10524:x1874693595391616:12345-192.168.201.21@tcp:49:lfs.0 00000100:00100000:1.0:1787847406.814419:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:10524:x1874693595391616:12345-192.168.201.21@tcp:49:lfs.0 Request processed in 159us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.814442:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:1.0:1787847406.814463:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:1.0:1787847406.814470:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:10525:x1874693595391872:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787847406.815459:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787847406.815574:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787847406.815626:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.815643:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.815654:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.816082:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.816091:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847406.816098:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847406.817331:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787847406.817476:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10525:x1874693595391872:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 2999us (3335us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787847406.817486:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000020:00080000:0.0:1787847406.817493:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787847406.818255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:2.0:1787847406.818504:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847406.818514:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.818523:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847406.818527:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.818536:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.818554:0:7621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d87e122eb00) 00010000:00010000:2.0:1787847406.818557:0:7621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787847406.818578:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.818584:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986244e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.818608:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847406.818610:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847406.818612:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847406.819394:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595392128 00000100:00100000:1.0:1787847406.819407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595392128 00000100:00100000:1.0:1787847406.819464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00100000:1.0:1787847406.819475:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10524:x1874693595392128:12345-192.168.201.21@tcp:58:lfs.0 00000040:00080000:1.0:1787847406.819809:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787847406.819920:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10524:x1874693595392128:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 447us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847406.819960:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 128 00000100:00100000:3.0:1787847406.852195:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.852339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595392256 00000100:00100000:2.0:1787847406.852349:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595392256 00000100:00100000:2.0:1787847406.852415:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 129 00000100:00100000:2.0:1787847406.852426:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:10527:x1874693595392256:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847406.852452:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847406.852473:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ddc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852554:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852565:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852581:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852588:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852608:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852982:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.852993:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.853002:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.853038:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.853051:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 21 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.853065:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616375168:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847406.853156:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847406.856884:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.857074:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616375168:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847406.857106:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847406.857170:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595392512 00000100:00100000:3.0:1787847406.857176:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595392512 00000100:00100000:3.0:1787847406.857231:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1787847406.857242:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:5585:x1874693595392512:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787847406.857542:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:5585:x1874693595392512:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 302us (670us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787847406.857550:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:3.0:1787847406.870125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847406.870239:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595392640 00000100:00100000:2.0:1787847406.870249:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595392640 00010000:00010000:2.0:1787847406.870300:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 23 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847406.870375:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:2.0:1787847406.870385:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:2347:x1874693595392640:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847406.870404:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847406.870412:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 23 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.870424:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 23 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.870450:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862375 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d9d expref: 23 pid: 5843 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.870465:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847406.870470:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.870480:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.870488:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847406.870525:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847406.870587:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:2347:x1874693595392640:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 202us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847406.870595:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00010000:00010000:3.0:1787847406.871161:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871171:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847406.871221:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787847406.871226:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847406.871247:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871269:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871279:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871286:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871293:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871314:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847406.871319:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871327:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871339:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847406.871341:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847406.871345:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871351:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b986245c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871363:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871369:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871375:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871380:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847406.871383:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871389:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871408:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d87c4d7ff00) 00010000:00010000:3.0:1787847406.871410:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847406.871414:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871420:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b9862455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ddc expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871470:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ddc expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847406.871477:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847406.871480:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847406.871482:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a600, rc 0) 00000100:00100000:3.0:1787847406.871523:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:10527:x1874693595392256:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 19098us (19336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847406.871531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 129 00010000:00010000:3.0:1787847407.063129:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787847407.841755:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787847407.841780:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787847407.842122:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787847407.842131:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787847407.842316:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616375296:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787847407.842670:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084df00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847407.857771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847407.857886:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595392768 00000100:00100000:1.0:1787847407.857905:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595392768 00000100:00100000:1.0:1787847407.858013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 130 00000100:00100000:1.0:1787847407.858027:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:10538:x1874693595392768:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787847407.858080:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787847407.858211:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:10538:x1874693595392768:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 188us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847407.858220:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 130 00000100:00100000:3.0:1787847407.859328:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616375296:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787847407.872414:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847407.872716:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595393024 00000100:00100000:3.0:1787847407.872731:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595393024 00000100:00100000:3.0:1787847407.872818:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00100000:3.0:1787847407.872839:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:10538:x1874693595393024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847407.872878:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847407.873235:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862471 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0de3 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847407.873382:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862478 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847407.873495:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847407.873513:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862478 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847407.873528:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787847407.873719:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9862471 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0de3 expref: 24 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847407.873743:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862478 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0de3 expref: 23 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847407.873753:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847407.873756:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847407.873761:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165ce00, rc 0) 00000100:00100000:3.0:1787847407.874403:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:10538:x1874693595393024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1562us (1998us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787847407.874433:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 131 00000100:00100000:1.0:1787847407.891253:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847407.891315:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595393280 00000100:00100000:1.0:1787847407.891328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595393280 00000100:00100000:1.0:1787847407.891421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 132 00000100:00100000:1.0:1787847407.891434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:10538:x1874693595393280:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787847407.891547:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.891570:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.891584:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.892319:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.892331:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.892353:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.892360:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847407.892365:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.892374:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.894213:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:1.0:1787847407.894226:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787847407.894245:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847407.894257:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862486 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847407.897126:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:10538:x1874693595393280:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 5677us (5880us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787847407.897144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 132 00000040:00080000:1.0:1787847407.897373:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847407.897379:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847407.901447:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787847407.901475:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787847407.903582:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847407.903647:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595393408 00000100:00100000:2.0:1787847407.903661:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595393408 00000100:00100000:2.0:1787847407.903747:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1787847407.903760:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:2345:x1874693595393408:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847407.903791:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847407.903837:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862478 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0de3 expref: 24 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847407.903866:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:2.0:1787847407.903873:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847407.903974:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:2345:x1874693595393408:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 216us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847407.903984:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1787847407.909148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847407.909295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595393664 00000100:00100000:2.0:1787847407.909310:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595393664 00000100:00100000:2.0:1787847407.909390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1787847407.909403:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:10538:x1874693595393664:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787847407.909741:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:10538:x1874693595393664:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 338us (607us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787847407.909750:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000040:00080000:3.0:1787847407.992309:0:12102:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787847407.992324:0:12102:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787847407.992380:0:12102:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787847407.992387:0:12102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787847408.089567:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847408.223154:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847408.240775:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595393920 00000100:00100000:0.0:1787847408.240795:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595393920 00000100:00080000:2.0:1787847408.241318:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847408.241901:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:0.0:1787847408.241921:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:10551:x1874693595393920:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847408.242550:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847408.242581:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986248d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dea expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.243509:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862494 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.243528:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862494 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.243546:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862494 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847408.243562:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787847408.245745:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986248d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dea expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.245781:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862494 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dea expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.245793:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:0.0:1787847408.245796:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787847408.245800:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe800, rc 0) 00000100:00100000:0.0:1787847408.246905:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:10551:x1874693595393920:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 4674us (23451us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787847408.246919:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 133 00000100:00100000:2.0:1787847408.260775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847408.260872:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394048 00000100:00100000:0.0:1787847408.260888:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394048 00000100:00100000:0.0:1787847408.261340:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 134 00000100:00100000:0.0:1787847408.261364:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:10551:x1874693595394048:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1787847408.262443:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262478:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262495:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262532:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262540:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262548:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262555:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847408.262560:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262568:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262581:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:0.0:1787847408.262584:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847408.262598:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847408.262606:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847408.262718:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:10551:x1874693595394048:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 1353us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847408.262728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 134 00000100:00100000:2.0:1787847408.380684:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847408.380847:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394176 00000100:00100000:3.0:1787847408.380861:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394176 00000100:00100000:3.0:1787847408.380997:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:3.0:1787847408.381011:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595394176:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:3.0:1787847408.381035:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847408.381061:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8daaa3/0x1835de88b98624a9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0df1 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847408.381098:0:7920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9062ee, atime: 0x6a9062ed, ctime: 0x6a9062ee, blocks: 0xb 00010000:00010000:3.0:1787847408.381125:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:3.0:1787847408.381131:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847408.381142:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8daaa3/0x1835de88b98624a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df1 expref: 7 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847408.381166:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c8daaa3/0x1835de88b98624a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df1 expref: 7 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847408.381183:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c200, rc 0) 00000100:00100000:3.0:1787847408.381277:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595394176:12345-192.168.201.21@tcp:101:cat.0 Request processed in 269us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847408.381307:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00080000:2.0:1787847408.381393:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847408.398819:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847408.399042:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394304 00000100:00100000:2.0:1787847408.399075:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394304 00002000:00100000:2.0:1787847408.399142:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d87f99a8000 x1874693595394304/t0(0) o3->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:624/0 lens 488/0 e 0 to 0 dl 1787847419 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847408.399155:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87f99a8000 with x1874693595394304 ext(0->4095) 00002000:00010000:2.0:1787847408.399161:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87f99a8000 00000100:00100000:2.0:1787847408.399205:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:2.0:1787847408.399226:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595394304:12345-192.168.201.21@tcp:3:cat.0 00000100:00100000:2.0:1787847408.401693:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595394304:12345-192.168.201.21@tcp:3:cat.0 Request processed in 2460us (2871us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787847408.401712:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00002000:00100000:2.0:1787847408.401726:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d87f99a8000 x1874693595394304/t0(0) o3->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:624/0 lens 488/4536 e 0 to 0 dl 1787847419 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847408.401736:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87f99a8000 with x1874693595394304 ext(0->4095) 00002000:00010000:2.0:1787847408.401744:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87f99a8000 00000100:00100000:1.0:1787847408.578436:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847408.578491:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847408.578535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847408.578679:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394688 00000100:00100000:0.0:1787847408.578692:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394688 00000100:00080000:1.0:1787847408.579187:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847408.579246:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:1.0:1787847408.579264:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595394688:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847408.579377:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2344:x1874693595394688:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 120us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847408.579385:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:3.0:1787847408.580531:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394432 00000100:00100000:3.0:1787847408.580547:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394432 00000100:00100000:3.0:1787847408.580616:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 287 00000100:00100000:3.0:1787847408.580627:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595394432:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847408.580784:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595394432:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 158us (2365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847408.581223:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394560 00000100:00100000:2.0:1787847408.581239:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394560 00000100:00100000:2.0:1787847408.581295:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:2.0:1787847408.581304:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2344:x1874693595394560:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847408.581343:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2344:x1874693595394560:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 41us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847408.581350:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00080000:2.0:1787847408.581375:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847408.582551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 287 00000100:00100000:2.0:1787847408.727287:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847408.727311:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616375424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847408.727378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847408.727479:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616375424 00000100:00100000:3.0:1787847408.727489:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616375424 00000100:00100000:3.0:1787847408.727564:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787847408.727575:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616375424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847408.727612:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847408.727691:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616375424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847408.727699:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787847408.727727:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616375424:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787847408.727884:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787847409.111544:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787847409.305139:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787847409.305164:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1787847410.138822:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847410.266324:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616375552:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.266401:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847410.266453:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616376064:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.266482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847410.266512:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787847410.266518:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616375680:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.266542:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847410.266560:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616376192:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847410.267096:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616375808:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267124:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847410.267146:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847410.267152:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616375936:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847410.267225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616375552 00000100:00100000:3.0:1787847410.267232:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616375552 00000100:00100000:3.0:1787847410.267276:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787847410.267285:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616375552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267334:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616375552:12345-0@lo:400:kworker.0 Request processed in 50us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847410.267342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787847410.267373:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376064 00000100:00100000:3.0:1787847410.267378:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376064 00000100:00100000:3.0:1787847410.267411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616375680 00000100:00100000:3.0:1787847410.267414:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616375680 00000100:00100000:3.0:1787847410.267425:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616375808 00000100:00100000:3.0:1787847410.267428:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616375808 00000100:00100000:3.0:1787847410.267443:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787847410.267448:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616376064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267480:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616376064:12345-0@lo:400:kworker.0 Request processed in 31us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847410.267486:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787847410.267498:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787847410.267504:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616375680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267530:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616375680:12345-0@lo:400:kworker.0 Request processed in 27us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847410.267544:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787847410.267555:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787847410.267561:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616375808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.267595:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616375808:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847410.267601:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787847410.268843:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376192 00000100:00100000:2.0:1787847410.268854:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376192 00000100:00100000:2.0:1787847410.268902:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616375936 00000100:00100000:2.0:1787847410.268905:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616375936 00000100:00100000:2.0:1787847410.268928:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787847410.268955:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616376192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847410.269588:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787847410.269832:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616376192:12345-0@lo:400:kworker.0 Request processed in 878us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847410.269841:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787847410.269901:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616375680:0@lo:400:kworker.0 00000100:00100000:2.0:1787847410.269914:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616376192:0@lo:400:kworker.0 00000100:00100000:2.0:1787847410.269924:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616375552:0@lo:400:kworker.0 00000100:00100000:2.0:1787847410.269961:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616376064:0@lo:400:kworker.0 00000100:00080000:3.0:1787847410.270125:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787847410.270129:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787847410.270132:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847410.270155:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616375808:0@lo:400:kworker.0 00000100:00100000:0.0:1787847410.270296:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616375936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847410.270353:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616375936:12345-0@lo:400:kworker.0 Request processed in 755us (3176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847410.270360:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787847410.271183:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787847410.271189:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1787847410.271218:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87f7f9cf00, transno 4294967304 00000100:00100000:3.0:1787847410.271241:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616375936:0@lo:400:kworker.0 00000100:00100000:3.0:1787847410.776877:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616376320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847410.777060:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847410.777361:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376320 00000100:00100000:1.0:1787847410.777369:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376320 00000100:00100000:1.0:1787847410.777429:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787847410.777439:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616376320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847410.777480:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847410.777541:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616376320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847410.777548:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787847410.777899:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616376320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787847411.160095:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787847411.873566:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1787847411.873595:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1787847411.891194:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1787847411.891248:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787847411.891288:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d880084d240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787847411.891294:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d880084dd80 00000020:00080000:3.0:1787847411.891298:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efab8000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87c33d5000 00000020:00080000:3.0:1787847411.891315:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787847411.891691:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1787847412.183537:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787847413.018091:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787847413.018105:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787847413.018486:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1787847413.018494:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787847413.222655:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847413.686631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847413.686685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847413.686752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847413.686847:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847413.686877:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847413.687066:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394944 00000100:00100000:2.0:1787847413.687080:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394944 00000100:00100000:2.0:1787847413.687194:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395328 00000100:00100000:2.0:1787847413.687199:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395328 00000100:00100000:2.0:1787847413.687231:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:2.0:1787847413.687243:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2347:x1874693595394944:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847413.687352:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2347:x1874693595394944:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 110us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.687361:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:2.0:1787847413.687399:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 142 00000100:00100000:2.0:1787847413.687406:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595395328:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847413.687433:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595395328:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.687439:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 142 00000100:00100000:2.0:1787847413.687458:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395200 00000100:00100000:2.0:1787847413.687461:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395200 00000100:00100000:2.0:1787847413.687486:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395072 00000100:00100000:2.0:1787847413.687489:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395072 00000100:00100000:2.0:1787847413.687509:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:2.0:1787847413.687516:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595395200:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847413.687541:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595395200:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 26us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.687548:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:2.0:1787847413.687558:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:2.0:1787847413.687563:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2347:x1874693595395072:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847413.687583:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2347:x1874693595395072:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 20us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.687589:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00080000:1.0:1787847413.688114:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787847413.688121:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787847413.688124:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847413.689446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595394816 00000100:00100000:0.0:1787847413.689462:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595394816 00000100:00100000:2.0:1787847413.689662:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 289 00000100:00100000:2.0:1787847413.689675:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595394816:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847413.689774:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595394816:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 103us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.689781:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 289 00000100:00100000:1.0:1787847413.719488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847413.724384:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395456 00000100:00100000:2.0:1787847413.724408:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395456 00000100:00100000:2.0:1787847413.724520:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 135 00000100:00100000:2.0:1787847413.724533:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10204:x1874693595395456:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787847413.724692:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10204:x1874693595395456:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 Request processed in 161us (5220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.724701:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 135 00000100:00100000:0.0:1787847413.747841:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847413.748120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395712 00000100:00100000:2.0:1787847413.748134:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395712 00000100:00100000:2.0:1787847413.748219:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:2.0:1787847413.748232:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:10204:x1874693595395712:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787847413.748810:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:10204:x1874693595395712:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 579us (980us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1787847413.748818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:2.0:1787847413.847287:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847413.847320:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616376448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847413.847430:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847413.847700:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376448 00000100:00100000:1.0:1787847413.847710:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376448 00000100:00100000:1.0:1787847413.847818:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787847413.847830:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616376448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847413.847875:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847413.847987:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616376448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847413.847997:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1787847413.848122:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847413.848218:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616376448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847413.976825:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847413.977332:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395840 00000100:00100000:2.0:1787847413.977346:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395840 00000100:00100000:2.0:1787847413.977412:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 136 00000100:00100000:2.0:1787847413.977424:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+5:11004:x1874693595395840:12345-192.168.201.21@tcp:101:lsof.0 00010000:00010000:2.0:1787847413.977451:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847413.977478:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98624b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0df8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847413.977581:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847413.977619:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847413.977634:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847413.978306:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787847413.978315:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847413.978457:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847413.978501:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98624b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847413.978534:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847413.978552:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847413.978556:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847413.978560:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847413.978738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4cd94325-5cad-4012-9431-9a61496a2886+6:11004:x1874693595395840:12345-192.168.201.21@tcp:101:lsof.0 Request processed in 1314us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847413.978749:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 136 00010000:00010000:2.0:1787847414.231231:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847415.256665:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847415.383870:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616376576:0@lo:400:kworker.0 00000100:00100000:2.0:1787847415.384013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847415.386496:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616376704:0@lo:400:kworker.0 00000100:00100000:3.0:1787847415.386591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847415.386704:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376704 00000100:00100000:3.0:1787847415.386714:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376704 00000100:00100000:3.0:1787847415.386775:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787847415.386784:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800526d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616376704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847415.386839:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800526d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616376704:12345-0@lo:400:kworker.0 Request processed in 56us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847415.386847:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787847415.386900:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616376704:0@lo:400:kworker.0 00000100:00100000:1.0:1787847415.388915:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376576 00000100:00100000:1.0:1787847415.388943:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376576 00000100:00100000:1.0:1787847415.389028:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787847415.389040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616376576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.391666:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616376960:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.391768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847415.391828:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847415.391834:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616376832:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.391864:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847415.391902:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376960 00000100:00100000:0.0:1787847415.391910:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376960 00000100:00100000:0.0:1787847415.392000:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787847415.392014:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616376960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.392121:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616376960:12345-0@lo:400:kworker.0 Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847415.392130:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787847415.392161:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616376832 00000100:00100000:0.0:1787847415.392165:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616376832 00000100:00100000:0.0:1787847415.392199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787847415.392207:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616376832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.392244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616376832:12345-0@lo:400:kworker.0 Request processed in 38us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847415.392251:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1787847415.392279:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787847415.392285:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847415.392321:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99ab0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616376832:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.392331:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616376960:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.392355:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616377216:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.392381:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847415.392409:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847415.392415:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616377088:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.392436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847415.392751:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377088 00000100:00100000:3.0:1787847415.392756:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377088 00000100:00100000:3.0:1787847415.392802:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787847415.392810:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616377088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847415.392853:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616377088:12345-0@lo:400:kworker.0 Request processed in 44us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847415.392859:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787847415.392894:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616377088:0@lo:400:kworker.0 00000100:00100000:3.0:1787847415.392926:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377216 00000100:00100000:3.0:1787847415.392955:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377216 00000100:00100000:3.0:1787847415.392996:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787847415.393002:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616377216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847415.393041:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99aa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616377216:12345-0@lo:400:kworker.0 Request processed in 40us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847415.393048:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787847415.393074:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787847415.393081:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787847415.393126:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616377216:0@lo:400:kworker.0 00000100:00080000:0.0:1787847415.394000:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847415.394007:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847415.395877:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616376576:12345-0@lo:400:kworker.0 Request processed in 6821us (11846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847415.395898:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787847415.396184:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616376576:0@lo:400:kworker.0 00000100:00100000:0.0:1787847415.896124:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847415.896161:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616377344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847415.896269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847415.896514:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377344 00000100:00100000:1.0:1787847415.896526:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377344 00000100:00100000:1.0:1787847415.896588:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787847415.896608:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616377344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847415.896656:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847415.896732:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616377344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847415.896740:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787847415.897819:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616377344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787847416.286565:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847417.016756:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787847417.016786:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787847417.020972:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787847417.020991:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787847417.308211:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787847417.694243:0:12305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 12:16:56 (1787847416) 00010000:00010000:2.0:1787847418.331483:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847418.818263:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847418.818323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847418.818923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847418.819012:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595395968 00000100:00100000:2.0:1787847418.819026:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595395968 00000100:00100000:2.0:1787847418.819109:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 291 00000100:00100000:2.0:1787847418.819122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595395968:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847418.819235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595395968:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 114us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847418.819243:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 291 00000100:00100000:0.0:1787847418.819608:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396096 00000100:00100000:0.0:1787847418.819615:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396096 00000100:00100000:3.0:1787847418.819663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847418.819693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:0.0:1787847418.819709:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2345:x1874693595396096:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847418.819722:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847418.819779:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2345:x1874693595396096:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 75us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847418.819787:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:0.0:1787847418.819801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396480 00000100:00100000:0.0:1787847418.819804:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396480 00000100:00100000:0.0:1787847418.819827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 147 00000100:00100000:0.0:1787847418.819833:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+6:2344:x1874693595396480:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847418.819924:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396224 00000100:00100000:1.0:1787847418.820016:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396352 00000100:00100000:1.0:1787847418.820023:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396352 00000100:00080000:2.0:1787847418.820103:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847418.820109:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847418.828482:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:1.0:1787847418.828511:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595396352:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847418.828882:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4cd94325-5cad-4012-9431-9a61496a2886+6:2344:x1874693595396480:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 9045us (9165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847418.828895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 147 00000100:00100000:3.0:1787847418.829376:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396224 00000100:00100000:3.0:1787847418.829487:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:3.0:1787847418.829499:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595396224:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847418.829575:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595396224:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 80us (10661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847418.829583:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1787847418.830152:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2345:x1874693595396352:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 1649us (10486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847418.830164:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00080000:0.0:1787847418.835355:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847418.968914:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847418.969075:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616377472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847418.969148:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847418.969326:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377472 00000100:00100000:1.0:1787847418.969340:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377472 00000100:00100000:1.0:1787847418.969443:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787847418.969455:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616377472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847418.969505:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847418.969607:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616377472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847418.969616:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787847418.969684:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616377472:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787847418.975666:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847419.243331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847419.243461:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396736 00000100:00100000:0.0:1787847419.243470:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396736 00000100:00100000:0.0:1787847419.243522:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:0.0:1787847419.243529:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:11270:x1874693595396736:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847419.243551:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847419.243580:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98624be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0dff expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.243668:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.243694:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.243705:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.243717:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.243721:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.243725:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.244920:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98624d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.244964:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98624d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.244974:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98624d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847419.244986:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787847419.246470:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246484:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246492:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246510:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847419.246515:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246524:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246542:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d87c7207000) 00010000:00010000:0.0:1787847419.246546:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847419.246550:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246557:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246572:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246578:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246583:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246588:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847419.246591:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246596:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246615:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d87c7207b00) 00010000:00010000:0.0:1787847419.246618:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847419.246621:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.246627:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98624cc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.247872:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98624be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dff expref: 16 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.247897:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98624d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dff expref: 15 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.247906:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:0.0:1787847419.247909:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847419.247913:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afee00, rc 0) 00000100:00100000:0.0:1787847419.248032:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:11270:x1874693595396736:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 4501us (4861us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787847419.248052:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 137 00000100:00100000:2.0:1787847419.256719:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847419.257424:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847419.257734:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396864 00000100:00100000:3.0:1787847419.257744:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396864 00000100:00100000:3.0:1787847419.260362:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 138 00000100:00100000:3.0:1787847419.260389:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:11270:x1874693595396864:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787847419.260517:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:11270:x1874693595396864:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 Request processed in 140us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847419.260526:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 138 00000100:00100000:0.0:1787847419.262186:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595396992 00000100:00100000:0.0:1787847419.262201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595396992 00000100:00100000:0.0:1787847419.262298:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:0.0:1787847419.262309:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:2344:x1874693595396992:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847419.262324:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847419.262350:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98624d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dff expref: 15 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847419.262392:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:0.0:1787847419.262397:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847419.262465:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f89850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:2344:x1874693595396992:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 157us (5759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847419.262473:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00010000:00010000:3.0:1787847419.351472:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787847420.184874:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847420.184886:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847420.185517:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787847420.185530:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787847420.378665:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847420.511276:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616377856:0@lo:400:kworker.0 00000100:00100000:0.0:1787847420.511403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847420.511480:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847420.511487:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616377984:0@lo:400:kworker.0 00000100:00100000:0.0:1787847420.511524:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847420.511565:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377984 00000100:00100000:0.0:1787847420.511574:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377984 00000100:00100000:0.0:1787847420.511633:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787847420.511645:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616377984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847420.511717:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616377984:12345-0@lo:400:kworker.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847420.511725:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787847420.511776:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616377984:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.511846:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616377728:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.511878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847420.511901:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616378240:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.511919:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847420.511968:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787847420.511973:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616377600:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512002:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847420.512034:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616378112:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512054:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847420.512083:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377856 00000100:00100000:3.0:1787847420.512087:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377856 00000100:00100000:3.0:1787847420.512120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377728 00000100:00100000:3.0:1787847420.512123:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377728 00000100:00100000:3.0:1787847420.512135:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616378112 00000100:00100000:3.0:1787847420.512137:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616378112 00000100:00100000:3.0:1787847420.512153:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787847420.512159:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616377856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512197:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616377856:12345-0@lo:400:kworker.0 Request processed in 39us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847420.512223:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787847420.512238:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787847420.512244:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616377728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512277:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616377728:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847420.512284:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787847420.512297:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787847420.512303:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616378112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512337:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616378112:12345-0@lo:400:kworker.0 Request processed in 36us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847420.512343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787847420.512363:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616378240 00000100:00100000:3.0:1787847420.512366:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616378240 00000100:00100000:3.0:1787847420.512391:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787847420.512396:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512421:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616378240:12345-0@lo:400:kworker.0 Request processed in 26us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847420.512427:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787847420.512448:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616377600 00000100:00100000:3.0:1787847420.512452:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616377600 00000100:00100000:3.0:1787847420.512474:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787847420.512481:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616377600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616377600:12345-0@lo:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847420.512523:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1787847420.512578:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616377600:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512588:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616378112:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512595:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616377728:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512603:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616378240:0@lo:400:kworker.0 00000100:00100000:3.0:1787847420.512632:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616377856:0@lo:400:kworker.0 00000100:00080000:2.0:1787847420.512744:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847420.512750:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787847420.512753:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847421.017051:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847421.017084:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616378368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847421.017186:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847421.017284:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616378368 00000100:00100000:2.0:1787847421.017293:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616378368 00000100:00100000:2.0:1787847421.017633:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787847421.017646:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616378368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847421.017694:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847421.017826:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616378368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 183us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847421.017834:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787847421.017910:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616378368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787847421.399225:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847421.571459:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.571553:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595397120 00000100:00100000:3.0:1787847421.571568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595397120 00000100:00100000:3.0:1787847421.571677:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 139 00000100:00100000:3.0:1787847421.571692:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:11312:x1874693595397120:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847421.571724:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847421.571755:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.571845:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.571865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.571881:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.571898:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.571907:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.571968:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572310:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572320:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572328:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572334:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.572340:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572348:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572364:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847421.572368:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.572375:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572382:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98624e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572401:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572407:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572420:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572426:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165cc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.572429:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572435:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572443:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d87c3361a00) 00010000:00010000:3.0:1787847421.572446:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.572449:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572455:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b98624ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572498:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e06 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572510:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847421.572513:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.572516:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e06 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.572527:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165dc00, rc 0) 00000100:00100000:3.0:1787847421.572616:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:11312:x1874693595397120:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 927us (1174us total) trans 0 rc 301/301 00000100:00100000:3.0:1787847421.572634:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 139 00000100:00080000:2.0:1787847421.572877:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847421.590778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847421.590878:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595397376 00000100:00100000:0.0:1787847421.590892:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595397376 00000100:00100000:0.0:1787847421.591013:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 140 00000100:00100000:0.0:1787847421.591026:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:11312:x1874693595397376:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:0.0:1787847421.591105:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847421.591141:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9861e5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c3f expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.591175:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847421.591182:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847421.591555:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.591574:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.591586:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.591630:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 5 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.591649:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 5 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847421.591668:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616378496:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847421.591793:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed300 going to sleep for 11 seconds 00000100:00100000:0.0:1787847421.601395:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847421.602791:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595397504 00000100:00100000:2.0:1787847421.602807:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595397504 00010000:00010000:2.0:1787847421.602885:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 6 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847421.602951:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1787847421.602963:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:2346:x1874693595397504:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847421.602979:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847421.602986:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 6 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847421.603009:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 6 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847421.603045:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847421.603053:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847421.603065:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847421.603073:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847421.603105:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847421.603202:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:2346:x1874693595397504:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 240us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847421.603212:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00080000:2.0:1787847421.603240:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787847421.612022:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98624b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df8 expref: 5 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847421.612053:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99aad00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616378496:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847421.612086:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.612098:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.612104:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.612140:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.612171:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.612183:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847421.613500:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787847421.613520:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.613530:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.613549:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.613556:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.613562:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.613571:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.613590:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847421.613594:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.613600:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.613607:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98624f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847421.613629:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000074a09d64 reply state 0000000000395751 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847421.613640:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847421.613790:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:11312:x1874693595397376:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 22763us (23022us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787847421.613802:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 140 00010000:00010000:3.0:1787847421.618691:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.618713:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.618744:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.618751:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165dc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.618757:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.618767:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.618790:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d87c3361a00) 00010000:00010000:3.0:1787847421.618793:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.618798:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.618805:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b98624fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847421.719504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.719583:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595397632 00000100:00100000:3.0:1787847421.719598:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595397632 00000100:00100000:3.0:1787847421.719688:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:3.0:1787847421.719702:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+14:11320:x1874693595397632:12345-192.168.201.21@tcp:101:lctl.0 00010000:00010000:3.0:1787847421.719739:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847421.719768:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862504 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e0d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.719864:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b986250b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.720149:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b986250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.720165:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b986250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847421.720347:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787847421.720351:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847421.720378:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b986250b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.720474:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862504 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e0d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.720495:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b986250b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e0d expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.720502:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:3.0:1787847421.720505:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847421.720508:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165cc00, rc 0) 00000100:00100000:3.0:1787847421.720716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:11320:x1874693595397632:12345-192.168.201.21@tcp:101:lctl.0 Request processed in 1017us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847421.720722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 141 00000100:00100000:2.0:1787847421.798441:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.798615:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595397760 00000100:00100000:3.0:1787847421.798626:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595397760 00000100:00100000:3.0:1787847421.798704:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 142 00000100:00100000:3.0:1787847421.798715:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+15:11326:x1874693595397760:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847421.798741:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847421.798781:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e14 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.798853:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.798866:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.798879:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.798893:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.798901:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.798907:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799141:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799151:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799158:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847421.799191:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787847421.799195:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847421.799217:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799237:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799244:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799251:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799256:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.799260:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799267:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799279:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:3.0:1787847421.799282:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.799287:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799293:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799307:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799312:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799318:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799328:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.799331:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799337:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799343:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d87c3361200) 00010000:00010000:3.0:1787847421.799346:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.799348:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799354:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862520 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799379:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e14 expref: 17 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799391:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e14 expref: 16 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.799758:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847421.799763:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787847421.799766:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165ce00, rc 0) 00000100:00100000:3.0:1787847421.799835:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:11326:x1874693595397760:12345-192.168.201.21@tcp:101:bash.0 Request processed in 1121us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847421.799842:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 142 00000100:00100000:2.0:1787847421.804343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847421.804540:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595398016 00000100:00100000:0.0:1787847421.804551:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595398016 00000100:00100000:0.0:1787847421.804624:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 143 00000100:00100000:0.0:1787847421.804634:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+16:11326:x1874693595398016:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847421.804656:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847421.804682:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b986252e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e1b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.804839:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.804853:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.804864:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.804927:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.804978:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.804985:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787847421.805557:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787847421.805722:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805740:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805775:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805791:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805797:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805803:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847421.805806:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805813:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805825:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:0.0:1787847421.805827:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847421.805831:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805836:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862535 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847421.805848:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b946620c reply state 00000000b940a527 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847421.805857:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787847421.805887:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b986252e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805902:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.805920:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847421.805923:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847421.805925:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:0.0:1787847421.806048:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11326:x1874693595398016:12345-192.168.201.21@tcp:101:bash.0 Request processed in 1413us (1712us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787847421.806056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 143 00010000:00010000:3.0:1787847421.808150:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.808181:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.808256:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.808263:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847421.808267:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.808275:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.808291:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c7207b00) 00010000:00010000:3.0:1787847421.808294:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847421.808298:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.808305:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986253c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847421.813162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847421.813479:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595398144 00000100:00100000:0.0:1787847421.813493:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595398144 00000100:00100000:0.0:1787847421.813593:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:0.0:1787847421.813608:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595398144:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847421.813635:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847421.813670:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e22 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787847421.813712:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847421.813747:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1787847421.813754:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847421.813767:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.813792:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.813812:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe400, rc 0) 00000100:00100000:0.0:1787847421.813905:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595398144:12345-192.168.201.21@tcp:101:bash.0 Request processed in 300us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847421.813961:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00080000:2.0:1787847421.814562:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847421.822097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.822678:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595398272 00000100:00100000:3.0:1787847421.822693:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595398272 00000100:00100000:3.0:1787847421.822779:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1787847421.822792:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:11326:x1874693595398272:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847421.822820:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847421.822846:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e29 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.822917:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.822927:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847421.822961:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847421.822968:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.823134:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.823152:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847421.823170:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7920:1874693616378624:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847421.823297:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847421.830280:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7920:1874693616378624:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847421.830334:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.830363:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165dc00, rc 0) 00000100:00100000:3.0:1787847421.830570:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:11326:x1874693595398272:12345-192.168.201.21@tcp:101:bash.0 Request processed in 7780us (8489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847421.830582:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:2.0:1787847421.834190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.834487:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595398400 00000100:00100000:3.0:1787847421.834500:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595398400 00010000:00010000:3.0:1787847421.834630:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847421.838757:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:3.0:1787847421.838793:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595398400:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847421.838829:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847421.838870:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.838893:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.838923:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ccbbaca/0x1835de88b9862551 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e22 expref: 7 pid: 6677 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.840475:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847421.840483:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847421.840498:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847421.840513:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847421.840911:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847421.840963:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d1e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874693616378752:192.168.201.21@tcp:105: 00000100:00100000:2.0:1787847421.841101:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c33dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847421.844741:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d1e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1874693616378752:192.168.201.21@tcp:105: 00010000:00010000:3.0:1787847421.844798:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847421.844965:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595398400:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 6160us (10757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847421.844980:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1787847421.851737:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.851914:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595398656 00000100:00100000:3.0:1787847421.851927:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595398656 00000100:00100000:3.0:1787847421.852325:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:3.0:1787847421.852339:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:11326:x1874693595398656:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:2.0:1787847421.857771:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11326:x1874693595398656:12345-192.168.201.21@tcp:35:bash.0 Request processed in 5417us (6033us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787847421.857789:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1787847421.947684:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847421.947868:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595398912 00000100:00100000:0.0:1787847421.947882:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595398912 00000100:00100000:0.0:1787847421.948035:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 144 00000100:00100000:0.0:1787847421.948049:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11336:x1874693595398912:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847421.948083:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847421.948114:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986255f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e30 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847421.948453:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787847421.948731:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986255f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e30 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.948750:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:0.0:1787847421.948753:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847421.948760:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b986255f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e30 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847421.948777:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affa00, rc 0) 00000100:00100000:0.0:1787847421.948873:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11336:x1874693595398912:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 827us (1205us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787847421.948883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 144 00000100:00100000:2.0:1787847421.955360:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847421.955670:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595399168 00000100:00100000:3.0:1787847421.955683:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595399168 00000100:00100000:3.0:1787847421.955756:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:3.0:1787847421.955768:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11336:x1874693595399168:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847421.956208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:11336:x1874693595399168:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 440us (862us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787847421.956218:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:2.0:1787847422.062508:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.063442:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595399296 00000100:00100000:3.0:1787847422.063460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595399296 00000100:00100000:3.0:1787847422.067499:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 145 00000100:00100000:3.0:1787847422.067668:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:11342:x1874693595399296:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847422.067705:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847422.067735:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986256d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e37 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.067826:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.067843:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.067866:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847422.068182:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787847422.068188:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847422.068276:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.068312:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986256d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e37 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.068333:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e37 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.068344:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847422.068347:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847422.068352:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:3.0:1787847422.068440:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:11342:x1874693595399296:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 915us (5947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847422.068450:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 145 00000100:00100000:3.0:1787847422.093977:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847422.094038:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595399552 00000100:00100000:2.0:1787847422.094051:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595399552 00000100:00100000:2.0:1787847422.094127:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:2.0:1787847422.094139:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:11342:x1874693595399552:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847422.094168:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847422.094206:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986257b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e3e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.094344:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862582 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.094363:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.094378:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862582 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847422.094392:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787847422.094909:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b986257b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e3e expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.094960:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862582 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e3e expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.094970:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:2.0:1787847422.094975:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847422.094980:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847422.095078:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11342:x1874693595399552:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 940us (1116us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787847422.095351:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 146 00000100:00100000:0.0:1787847422.101718:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.101979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595399808 00000100:00100000:3.0:1787847422.102002:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595399808 00000100:00100000:3.0:1787847422.102080:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 147 00000100:00100000:3.0:1787847422.102091:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11342:x1874693595399808:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847422.102124:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847422.102150:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862590 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e45 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.102292:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862597 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.102310:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.102324:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862597 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847422.102340:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787847422.102492:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862590 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e45 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.102514:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e45 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.102527:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:3.0:1787847422.102531:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787847422.102535:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:3.0:1787847422.102613:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11342:x1874693595399808:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 523us (912us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787847422.102621:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 147 00000100:00100000:2.0:1787847422.105317:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.106537:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595399936 00000100:00100000:0.0:1787847422.106555:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595399936 00000100:00100000:0.0:1787847422.106846:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1787847422.106858:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:2345:x1874693595399936:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847422.106967:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847422.107012:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862582 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e3e expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.107036:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847422.107043:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847422.107562:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+25:2345:x1874693595399936:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 702us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847422.107572:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000001:00080000:1.0:1787847422.118414:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967419 is committed 00000001:00080000:1.0:1787847422.118453:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000100:00100000:1.0:1787847422.124257:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.124390:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595400064 00000100:00100000:0.0:1787847422.124407:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595400064 00000100:00100000:0.0:1787847422.124484:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:0.0:1787847422.124498:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595400064:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:0.0:1787847422.124564:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.124591:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.124601:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847422.124607:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787847422.124612:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.124663:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 6 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.124707:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 6 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847422.124727:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874693616378880:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847422.124861:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaeda80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847422.136623:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.136743:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595400192 00000100:00100000:3.0:1787847422.136757:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595400192 00002000:00100000:3.0:1787847422.136825:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d87e6d1e1c0 x1874693595400192/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:638/0 lens 504/0 e 0 to 0 dl 1787847433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787847422.136837:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6d1e1c0 with x1874693595400192 ext(0->12) 00010000:00010000:3.0:1787847422.136868:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 7 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.136897:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 7 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847422.136907:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87e6d1e1c0 00000100:00100000:2.0:1787847422.137138:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1787847422.137153:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595400192:12345-192.168.201.21@tcp:4:lfs.0 00000100:00100000:2.0:1787847422.137795:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2346:x1874693595400192:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 642us (1183us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787847422.137807:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00002000:00100000:2.0:1787847422.137817:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d87e6d1e1c0 x1874693595400192/t4294967305(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:638/0 lens 504/448 e 0 to 0 dl 1787847433 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847422.137826:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e6d1e1c0 with x1874693595400192 ext(0->12) 00010000:00010000:2.0:1787847422.137834:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 9 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.137850:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 9 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787847422.137858:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87e6d1e1c0 00000100:00100000:0.0:1787847422.140309:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6677:1874693616378880:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847422.140349:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847422.145390:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.147694:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595400320 00000100:00100000:0.0:1787847422.147715:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595400320 00010000:00010000:2.0:1787847422.147985:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 9 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847422.148052:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:2.0:1787847422.148065:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2344:x1874693595400320:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847422.148099:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787847422.148130:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787847422.148133:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787847422 00002000:00010000:2.0:1787847422.148136:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787847422 00002000:00010000:2.0:1787847422.148138:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787847422 00010000:00010000:2.0:1787847422.148147:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 9 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.148184:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 9 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.148219:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c434446e/0x1835de88b9862558 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e29 expref: 9 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.148244:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847422.148250:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847422.148257:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.148271:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.148422:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847422.148509:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2344:x1874693595400320:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 445us (3133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847422.148519:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00010000:00010000:0.0:1787847422.149273:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149290:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149329:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149339:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149350:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149376:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847422.149383:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149395:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149415:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.149424:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025405cc8/0x1835de88b98625a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847422.149558:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595400064:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 25060us (25313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847422.149568:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:2.0:1787847422.158136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.163480:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595400576 00000100:00100000:3.0:1787847422.163504:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595400576 00000100:00100000:2.0:1787847422.164841:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:2.0:1787847422.164857:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11342:x1874693595400576:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:2.0:1787847422.165628:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862597 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e45 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787847422.166102:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787847422.166161:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787847422.183511:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787847422.183724:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.183754:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.183766:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.183824:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847422.183846:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 23 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847422.183867:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d1e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1874693616379008:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847422.184041:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d600 going to sleep for 11 seconds 00000100:00100000:2.0:1787847422.190757:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.190977:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d1e580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1874693616379008:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847422.191039:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847422.194439:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595400704 00000100:00100000:0.0:1787847422.194463:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595400704 00010000:00010000:0.0:1787847422.194545:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 24 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847422.194607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:0.0:1787847422.194618:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:2347:x1874693595400704:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847422.194638:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847422.194646:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 24 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.194681:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 24 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.194714:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e1b expref: 24 pid: 5844 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.194733:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847422.194740:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.194750:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.194759:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.194799:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847422.194887:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:2347:x1874693595400704:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 270us (4147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847422.194896:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00010000:00010000:3.0:1787847422.195131:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.195141:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787847422.195328:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1787847422.195627:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1787847422.195766:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874693616379136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787847422.195846:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847422.195901:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847422.196699:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616379136 00000100:00100000:0.0:1787847422.196711:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616379136 00000100:00100000:0.0:1787847422.196795:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787847422.196807:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874693616379136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787847422.196916:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874693616379136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 112us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847422.196924:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787847422.197031:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874693616379136:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787847422.198623:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787847422.199758:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787847422.199880:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874693616379264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787847422.200150:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847422.200237:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847422.200284:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616379264 00000100:00100000:1.0:1787847422.200294:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616379264 00000100:00100000:1.0:1787847422.200463:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847422.200476:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1874693616379264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787847422.200804:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1874693616379264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 330us (654us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787847422.200813:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787847422.200904:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a8b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1874693616379264:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787847422.201045:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787847422.201092:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.201116:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.201125:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.201132:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847422.201137:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.201146:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.201165:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:3.0:1787847422.201168:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787847422.201174:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.201180:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98625ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787847422.201372:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787847422.201706:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787847422.201719:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337025786893ns, next at 338025784643ns, rc = 0 00000001:00080000:3.0:1787847422.201727:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787847422.201758:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:3.0:1787847422.201761:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787847422.201769:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862597 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e45 expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847422.205289:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11342:x1874693595400576:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 40417us (47152us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787847422.205309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000020:00080000:3.0:1787847422.205321:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787847422.208189:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.208339:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595400832 00000100:00100000:3.0:1787847422.208352:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595400832 00000100:00100000:3.0:1787847422.208530:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 148 00000100:00100000:3.0:1787847422.208542:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11342:x1874693595400832:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847422.208577:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847422.208610:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b98625b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e4c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.208691:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b98625b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e4c expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.208709:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b98625b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e4c expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.208732:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847422.208736:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847422.208741:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c400, rc 0) 00000100:00100000:3.0:1787847422.208820:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:11342:x1874693595400832:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 279us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847422.208828:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 148 00000100:00100000:2.0:1787847422.217168:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.217268:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595401088 00000100:00100000:0.0:1787847422.217280:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595401088 00000100:00100000:0.0:1787847422.217351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:0.0:1787847422.217362:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:11342:x1874693595401088:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847422.217720:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11342:x1874693595401088:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 358us (567us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787847422.217728:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:2.0:1787847422.315324:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.315495:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595401344 00000100:00100000:3.0:1787847422.315509:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595401344 00000100:00100000:3.0:1787847422.315676:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 149 00000100:00100000:3.0:1787847422.315689:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11352:x1874693595401344:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847422.315725:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847422.315754:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98625ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e53 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847422.316181:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787847422.316368:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98625ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e53 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.316385:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:3.0:1787847422.316389:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847422.316394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98625ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e53 expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.316410:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:3.0:1787847422.316589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:11352:x1874693595401344:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 902us (1279us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787847422.316597:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 149 00000100:00100000:2.0:1787847422.324010:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847422.324124:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595401472 00000100:00100000:1.0:1787847422.324138:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595401472 00000100:00100000:1.0:1787847422.324211:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 150 00000100:00100000:1.0:1787847422.324225:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:11352:x1874693595401472:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:1.0:1787847422.324341:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324365:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324381:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324399:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324406:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324411:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324816:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324828:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324844:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787847422.324899:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324915:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324923:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324967:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324974:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847422.324978:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.324997:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325012:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:1.0:1787847422.325015:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847422.325021:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325027:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98625c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325042:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325055:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325061:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325067:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847422.325070:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325076:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325085:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87e122e700) 00010000:00010000:1.0:1787847422.325088:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847422.325090:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325097:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98625cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325113:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325118:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325124:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325129:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847422.325137:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325143:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325152:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:1.0:1787847422.325154:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847422.325157:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.325163:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98625d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847422.325269:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:11352:x1874693595401472:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1044us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847422.325279:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 150 00000100:00100000:2.0:1787847422.328383:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.328485:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595401728 00000100:00100000:0.0:1787847422.328499:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595401728 00000100:00100000:0.0:1787847422.328577:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:0.0:1787847422.328589:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:11352:x1874693595401728:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847422.329247:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:11352:x1874693595401728:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 657us (877us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787847422.329258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:2.0:1787847422.417327:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.425225:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595401984 00000100:00100000:0.0:1787847422.425247:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595401984 00000100:00100000:0.0:1787847422.425335:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:0.0:1787847422.425536:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:11355:x1874693595401984:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847422.425570:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847422.425602:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98625dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e5a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.425731:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.425749:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.425762:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.425778:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.425785:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.425792:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426223:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426234:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426241:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847422.426252:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787847422.426480:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426489:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426503:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426510:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847422.426515:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426525:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426540:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:0.0:1787847422.426543:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847422.426550:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426557:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98625e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426572:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426577:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426583:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426588:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847422.426591:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426607:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426616:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c7207e00) 00010000:00010000:0.0:1787847422.426618:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847422.426621:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426627:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98625eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426679:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98625dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426695:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.426702:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847422.426704:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847422.426706:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe400, rc 0) 00000100:00100000:0.0:1787847422.426876:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11355:x1874693595401984:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1345us (9564us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787847422.437288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 151 00010000:00010000:3.0:1787847422.437541:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847422.440486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847422.440887:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595402112 00000100:00100000:1.0:1787847422.440901:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595402112 00000100:00100000:1.0:1787847422.441037:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 152 00000100:00100000:1.0:1787847422.441049:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11355:x1874693595402112:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:1.0:1787847422.441453:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441479:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441495:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441532:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441551:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441560:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441568:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847422.441573:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441584:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441599:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:1.0:1787847422.441603:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787847422.441611:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.441618:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b9862600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847422.441868:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11355:x1874693595402112:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 818us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847422.441879:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 152 00000100:00100000:2.0:1787847422.446638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.446739:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595402368 00000100:00100000:0.0:1787847422.446754:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595402368 00000100:00100000:0.0:1787847422.446829:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:0.0:1787847422.446842:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11355:x1874693595402368:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847422.448167:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:11355:x1874693595402368:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 1316us (1533us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787847422.448181:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:2.0:1787847422.802610:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.802742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595402624 00000100:00100000:3.0:1787847422.802755:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595402624 00000100:00100000:3.0:1787847422.802839:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 153 00000100:00100000:3.0:1787847422.802853:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+33:11385:x1874693595402624:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:3.0:1787847422.802886:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847422.802914:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862607 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e61 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.803160:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986260e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.803179:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.803195:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986260e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847422.803209:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787847422.803379:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862607 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e61 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.803405:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986260e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e61 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.803416:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847422.803420:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847422.803424:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d200, rc 0) 00000100:00100000:3.0:1787847422.803510:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11385:x1874693595402624:12345-192.168.201.21@tcp:101:cat.0 Request processed in 659us (913us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787847422.803519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 153 00000100:00100000:2.0:1787847422.806772:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.806861:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595402752 00000100:00100000:3.0:1787847422.806873:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595402752 00000100:00100000:3.0:1787847422.806973:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1787847422.806995:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:2347:x1874693595402752:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847422.807017:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847422.807067:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986260e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e61 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.807094:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847422.807099:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847422.807191:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:2347:x1874693595402752:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 198us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847422.807200:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1787847422.819366:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.819780:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595403008 00000100:00100000:3.0:1787847422.819805:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595403008 00000100:00100000:3.0:1787847422.819887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:3.0:1787847422.819900:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:11385:x1874693595403008:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:3.0:1787847422.820300:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11385:x1874693595403008:12345-192.168.201.21@tcp:35:cat.0 Request processed in 402us (959us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787847422.820309:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:1.0:1787847422.890073:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.890197:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595403264 00000100:00100000:3.0:1787847422.890211:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595403264 00000100:00100000:3.0:1787847422.890294:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 154 00000100:00100000:3.0:1787847422.890307:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11392:x1874693595403264:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:3.0:1787847422.890343:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847422.890347:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787847422.890397:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e37 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.890426:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847422.890432:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847422.890452:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986261c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e68 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.890625:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.890643:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.890654:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.890694:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.890711:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 35 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847422.890726:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6e0fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616379392:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847422.891062:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847422.899061:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847422.899396:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595403392 00000100:00100000:0.0:1787847422.899409:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595403392 00010000:00010000:0.0:1787847422.899468:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847422.899526:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:0.0:1787847422.899538:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:2347:x1874693595403392:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847422.899557:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847422.899565:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.899581:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 36 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.899611:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847422.899618:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.899629:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.899638:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847422.899662:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847422.899749:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:2347:x1874693595403392:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 213us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847422.899758:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00010000:00010000:3.0:1787847422.900478:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98625f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e5a expref: 35 pid: 5843 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847422.900498:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6e0fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616379392:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847422.900530:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.900541:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.900779:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847422.900877:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787847422.901141:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b986261c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.901163:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.901173:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847422.901176:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847422.901180:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:3.0:1787847422.901307:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11392:x1874693595403264:12345-192.168.201.21@tcp:101:dd.0 Request processed in 11002us (11248us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787847422.901318:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 154 00000100:00100000:2.0:1787847422.911754:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847422.912474:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595403648 00000100:00100000:3.0:1787847422.912492:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595403648 00000100:00100000:3.0:1787847422.912959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 155 00000100:00100000:3.0:1787847422.912983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11392:x1874693595403648:12345-192.168.201.21@tcp:36:dd.0 00010000:00010000:3.0:1787847422.914836:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.914871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847422.914890:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787847422.920722:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787847422.920841:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7297ee9 reply state 00000000167a5adf transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847422.920858:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847422.921113:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:11392:x1874693595403648:12345-192.168.201.21@tcp:36:dd.0 Request processed in 8137us (9368us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787847422.921125:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 155 00000020:00080000:2.0:1787847422.921133:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787847422.924139:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.924163:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.924197:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.924205:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847422.924211:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.924222:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.924246:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:1.0:1787847422.924250:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847422.924257:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847422.924264:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862631 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847423.143173:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847423.147127:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595403776 00000100:00100000:1.0:1787847423.147149:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595403776 00000100:00100000:1.0:1787847423.147308:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 156 00000100:00100000:1.0:1787847423.147325:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+37:11406:x1874693595403776:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:1.0:1787847423.147358:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847423.147387:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e6f expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787847423.147523:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787847423.147530:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.147549:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.147582:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.147602:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.147610:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.147617:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.148021:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.148035:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.148043:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.148086:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.148102:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 38 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847423.148120:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616379520:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847423.148253:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847423.151468:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.151605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595404032 00000100:00100000:0.0:1787847423.151618:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595404032 00000100:00100000:0.0:1787847423.151708:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:0.0:1787847423.151721:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:5585:x1874693595404032:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787847423.151964:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d17c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616379520:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847423.152011:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847423.152569:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:5585:x1874693595404032:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 850us (1110us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787847423.152579:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:3.0:1787847423.155198:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.155556:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595404160 00000100:00100000:2.0:1787847423.155568:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595404160 00010000:00010000:2.0:1787847423.155619:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 40 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847423.155660:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:2.0:1787847423.155673:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:2347:x1874693595404160:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847423.155689:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847423.155695:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 40 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.155707:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 40 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.155731:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862623 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e68 expref: 40 pid: 5845 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.155771:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847423.155776:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.155785:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.155791:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.155825:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847423.155889:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:2347:x1874693595404160:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 220us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.155899:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00010000:00010000:0.0:1787847423.155927:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.155967:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847423.156036:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787847423.156042:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847423.156068:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156083:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156094:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156102:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156109:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156135:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.156141:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156150:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156162:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:0.0:1787847423.156166:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.156170:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156176:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b986263f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156190:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156195:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156202:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156207:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.156210:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156216:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156238:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87e122e700) 00010000:00010000:0.0:1787847423.156240:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.156244:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156250:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156295:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e6f expref: 39 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156312:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e6f expref: 38 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.156319:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847423.156322:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847423.156324:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5200, rc 0) 00000100:00100000:0.0:1787847423.156358:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:11406:x1874693595403776:12345-192.168.201.21@tcp:101:stat.0 Request processed in 9040us (13201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847423.156531:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 156 00000100:00100000:1.0:1787847423.233873:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.234021:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595404416 00000100:00100000:0.0:1787847423.234037:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595404416 00000100:00100000:0.0:1787847423.234125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 157 00000100:00100000:0.0:1787847423.234137:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:11412:x1874693595404416:12345-192.168.201.21@tcp:36:truncate.0 00010000:00010000:0.0:1787847423.234228:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847423.234275:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986264d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e6f expref: 38 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.234329:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847423.234336:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847423.234651:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.234669:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.234681:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847423.234749:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787847423.234778:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a19443db reply state 000000004b312599 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847423.234789:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787847423.235018:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d17c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:11412:x1874693595404416:12345-192.168.201.21@tcp:36:truncate.0 Request processed in 881us (1170us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787847423.235027:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 157 00000020:00080000:0.0:1787847423.235035:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787847423.248756:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.248784:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.248793:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.248801:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.248832:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.248842:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.248864:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847423.248867:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.248873:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.248880:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862654 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787847423.255333:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847423.255359:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847423.255630:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787847423.255641:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787847423.447294:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847423.540570:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.540710:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595404544 00000100:00100000:2.0:1787847423.540725:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595404544 00000100:00100000:2.0:1787847423.540805:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 158 00000100:00100000:2.0:1787847423.540817:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:11426:x1874693595404544:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:2.0:1787847423.540848:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847423.540887:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986265b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e76 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541016:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541037:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541052:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541091:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541100:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541107:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541512:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541523:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541531:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847423.541580:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787847423.541586:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847423.541609:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541625:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541634:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541640:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541657:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541664:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ac00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847423.541669:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541678:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541693:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:2.0:1787847423.541697:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847423.541703:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541710:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541727:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541734:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541741:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541746:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847423.541749:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541764:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541772:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c4d7ff00) 00010000:00010000:2.0:1787847423.541774:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847423.541777:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541784:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541820:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986265b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541834:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.541842:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847423.541844:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847423.541847:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847423.541998:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:11426:x1874693595404544:12345-192.168.201.21@tcp:101:stat.0 Request processed in 1183us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.542007:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 158 00000100:00100000:3.0:1787847423.642083:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.642351:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595404800 00000100:00100000:2.0:1787847423.642364:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595404800 00000100:00100000:2.0:1787847423.642458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 159 00000100:00100000:2.0:1787847423.642472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:11436:x1874693595404800:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847423.642535:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847423.642564:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847423.642914:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787847423.643169:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862677 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e7d expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.643187:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:2.0:1787847423.643191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847423.643197:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e7d expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.643212:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847423.643301:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+41:11436:x1874693595404800:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 832us (1233us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1787847423.643310:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 159 00000100:00100000:2.0:1787847423.649321:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.649499:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595405056 00000100:00100000:0.0:1787847423.649514:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595405056 00000100:00100000:0.0:1787847423.649594:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:0.0:1787847423.649606:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+41:11436:x1874693595405056:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847423.650482:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+42:11436:x1874693595405056:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 871us (1171us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787847423.650504:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:1.0:1787847423.709409:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.709616:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595405312 00000100:00100000:0.0:1787847423.709631:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595405312 00000100:00100000:0.0:1787847423.709715:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 160 00000100:00100000:0.0:1787847423.709729:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+42:11442:x1874693595405312:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847423.709766:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847423.709796:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862685 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e84 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.710010:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.710030:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.710041:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.710086:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.710101:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 43 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847423.710116:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f99a9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616379648:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847423.710245:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed300 going to sleep for 11 seconds 00000100:00100000:1.0:1787847423.715024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.715133:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595405440 00000100:00100000:2.0:1787847423.715146:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595405440 00010000:00010000:2.0:1787847423.715207:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 44 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847423.715258:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:2.0:1787847423.715270:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+44:2346:x1874693595405440:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847423.715291:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847423.715300:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 44 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.715335:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 44 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.715365:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847423.715383:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.715395:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.715404:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.715429:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847423.715507:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+44:2346:x1874693595405440:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 239us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.715516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00010000:00010000:0.0:1787847423.716012:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e76 expref: 43 pid: 5845 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847423.716035:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f99a9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616379648:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847423.716063:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.716074:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.716095:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847423.716119:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787847423.716329:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862685 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 44 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.716347:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 43 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.716358:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847423.716361:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787847423.716364:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe600, rc 0) 00000100:00100000:0.0:1787847423.716429:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:11442:x1874693595405312:12345-192.168.201.21@tcp:101:bash.0 Request processed in 6704us (7040us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787847423.716438:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 160 00000100:00100000:1.0:1787847423.720110:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.720235:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595405696 00000100:00100000:2.0:1787847423.720248:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595405696 00000100:00100000:2.0:1787847423.720325:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 161 00000100:00100000:2.0:1787847423.720337:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:11442:x1874693595405696:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:2.0:1787847423.720723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.720745:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.720759:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787847423.720847:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787847423.720875:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000f8051a1 reply state 00000000a8388dbd transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847423.720886:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847423.721270:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:11442:x1874693595405696:12345-192.168.201.21@tcp:36:bash.0 Request processed in 930us (1170us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787847423.721280:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 161 00000020:00080000:2.0:1787847423.721287:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787847423.724256:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.724283:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.724292:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.724301:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847423.724307:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.724318:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.724341:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:1.0:1787847423.724344:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847423.724427:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847423.724436:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b986269a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847423.729780:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.730136:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595405824 00000100:00100000:2.0:1787847423.730150:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595405824 00000100:00100000:2.0:1787847423.730308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 162 00000100:00100000:2.0:1787847423.730322:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+45:11442:x1874693595405824:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1787847423.730357:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847423.730395:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b98626a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.730525:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.730544:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 46 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.730556:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.730603:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 46 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.730646:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 46 pid: 7214 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847423.730666:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9bf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616379776:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847423.730781:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787847423.733325:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9bf2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616379776:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847423.733380:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847423.735301:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.735661:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595405952 00000100:00100000:2.0:1787847423.735674:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595405952 00010000:00010000:2.0:1787847423.735729:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 47 pid: 7214 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847423.735782:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:2.0:1787847423.735795:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:2347:x1874693595405952:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847423.735849:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847423.735858:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 47 pid: 7214 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.735874:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 47 pid: 7214 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.735909:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986268c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e84 expref: 47 pid: 7214 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.735991:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847423.735999:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.736012:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.736021:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.736156:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847423.736236:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:2347:x1874693595405952:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 442us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.736246:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00010000:00010000:3.0:1787847423.737782:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.737805:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847423.738146:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787847423.738152:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847423.738184:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.738237:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b98626a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e8b expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.738262:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e8b expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.738273:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847423.738277:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847423.738281:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ac00, rc 0) 00000100:00100000:2.0:1787847423.738507:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+45:11442:x1874693595405824:12345-192.168.201.21@tcp:101:bash.0 Request processed in 8186us (8741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.738519:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 162 00000100:00100000:2.0:1787847423.743331:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847423.743411:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595406208 00000100:00100000:3.0:1787847423.743425:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595406208 00000100:00100000:3.0:1787847423.743509:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:3.0:1787847423.743521:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+45:11442:x1874693595406208:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:3.0:1787847423.744101:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:11442:x1874693595406208:12345-192.168.201.21@tcp:35:bash.0 Request processed in 579us (783us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1787847423.744111:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:2.0:1787847423.837093:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.837216:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595406464 00000100:00100000:0.0:1787847423.837231:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595406464 00000100:00100000:0.0:1787847423.837318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 163 00000100:00100000:0.0:1787847423.837330:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+46:11452:x1874693595406464:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847423.837634:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847423.837665:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e92 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847423.838073:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787847423.838270:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e92 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.838302:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:0.0:1787847423.838305:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847423.838311:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e92 expref: 48 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.838327:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affa00, rc 0) 00000100:00100000:0.0:1787847423.840262:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:11452:x1874693595406464:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 2919us (3172us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787847423.840280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 163 00000100:00100000:1.0:1787847423.845183:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.845572:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595406592 00000100:00100000:0.0:1787847423.845584:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595406592 00000100:00100000:0.0:1787847423.845655:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 164 00000100:00100000:0.0:1787847423.845666:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:11452:x1874693595406592:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:0.0:1787847423.845769:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.845791:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.845806:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.845823:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.845832:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.845851:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.846264:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.846275:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.846284:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847423.847848:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.847880:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.847889:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.847897:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.847904:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.847910:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.847919:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.847955:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:0.0:1787847423.847986:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.847993:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848001:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848022:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848028:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848034:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848040:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.848043:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848049:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848057:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c7207e00) 00010000:00010000:0.0:1787847423.848060:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.848063:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848069:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848087:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848100:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848106:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848112:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.848115:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848121:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848130:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847423.848132:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.848135:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.848141:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847423.848449:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:11452:x1874693595406592:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 2777us (3273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847423.848462:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 164 00000100:00100000:2.0:1787847423.855646:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.855749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595406848 00000100:00100000:0.0:1787847423.855762:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595406848 00000100:00100000:0.0:1787847423.855838:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:0.0:1787847423.855851:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+47:11452:x1874693595406848:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847423.856770:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:11452:x1874693595406848:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 915us (1133us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787847423.856791:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:2.0:1787847423.906072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847423.906195:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407104 00000100:00100000:0.0:1787847423.906213:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407104 00000100:00100000:0.0:1787847423.906315:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:0.0:1787847423.906329:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:11455:x1874693595407104:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847423.906381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847423.906413:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0e99 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.906514:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.906534:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.906549:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.906566:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.906574:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.906580:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907056:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907080:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907089:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847423.907103:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787847423.907229:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907238:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907245:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907252:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.907257:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907266:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907280:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:0.0:1787847423.907283:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.907288:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907295:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98626d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907308:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907319:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907325:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907330:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847423.907333:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907339:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907347:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c7207e00) 00010000:00010000:0.0:1787847423.907350:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847423.907353:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907359:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98626e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907410:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e99 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907425:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e99 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847423.907433:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847423.907435:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847423.907446:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affa00, rc 0) 00000100:00100000:0.0:1787847423.907539:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:11455:x1874693595407104:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1212us (1486us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787847423.907548:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:1.0:1787847423.914672:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847423.914792:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.914863:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407360 00000100:00100000:2.0:1787847423.914881:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407360 00000100:00100000:2.0:1787847423.915026:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1787847423.915039:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:2346:x1874693595407360:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847423.915061:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847423.915095:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b98626e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e99 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847423.915118:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847423.915125:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847423.915206:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:2346:x1874693595407360:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.915214:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1787847423.922762:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407232 00000100:00100000:3.0:1787847423.922778:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407232 00000100:00100000:3.0:1787847423.922863:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:3.0:1787847423.922875:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:11455:x1874693595407232:12345-192.168.201.21@tcp:54:lfs.0 00000100:00100000:2.0:1787847423.923246:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.923330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.923386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847423.923416:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407744 00000100:00100000:2.0:1787847423.923424:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407744 00000100:00100000:2.0:1787847423.923485:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407616 00000100:00100000:2.0:1787847423.923489:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407616 00000100:00100000:2.0:1787847423.923518:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:2.0:1787847423.923546:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595407744:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847423.923646:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595407744:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 103us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.923655:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:2.0:1787847423.923675:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:2.0:1787847423.923682:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595407616:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847423.923708:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595407616:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847423.923714:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00080000:2.0:1787847423.923733:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787847423.923738:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847423.923778:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:3.0:1787847423.924268:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924291:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924320:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924353:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924360:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924367:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924372:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847423.924377:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924384:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924396:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:3.0:1787847423.924399:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847423.924404:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847423.924410:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b98626f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847423.925276:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:11455:x1874693595407232:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 2396us (10606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847423.925295:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:3.0:1787847423.925327:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407872 00000100:00100000:3.0:1787847423.925344:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407872 00000100:00080000:3.0:1787847423.925379:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847423.925504:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:3.0:1787847423.925513:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2346:x1874693595407872:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847423.925559:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2346:x1874693595407872:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 48us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847423.925566:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 151 00000100:00100000:0.0:1787847423.925688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595407488 00000100:00100000:0.0:1787847423.925701:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595407488 00000100:00100000:0.0:1787847423.925820:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 293 00000100:00100000:0.0:1787847423.925831:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595407488:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847423.925888:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de94fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595407488:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 59us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847423.925895:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 293 00000100:00100000:2.0:1787847423.943740:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847423.943854:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595408128 00000100:00100000:3.0:1787847423.943865:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595408128 00000100:00100000:3.0:1787847423.943955:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:3.0:1787847423.943975:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+49:11455:x1874693595408128:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847423.944450:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:11455:x1874693595408128:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 475us (721us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787847423.944460:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000004:00080000:1.0:1787847424.088454:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338912519288ns, next at 339912514709ns, rc = 0 00000100:00100000:2.0:1787847424.088504:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616379904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847424.088587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847424.089746:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616379904 00000100:00100000:1.0:1787847424.089758:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616379904 00000100:00100000:2.0:1787847424.090031:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787847424.090043:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88002b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616379904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787847424.090083:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847424.090179:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88002b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616379904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847424.090188:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787847424.090304:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616379904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787847424.091553:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787847424.173135:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.173840:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595408384 00000100:00100000:0.0:1787847424.173852:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595408384 00000100:00100000:0.0:1787847424.173971:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 167 00000100:00100000:0.0:1787847424.173985:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:11474:x1874693595408384:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:0.0:1787847424.174012:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847424.174033:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ea0 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.174148:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862703 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.174164:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.174175:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847424.174205:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787847424.174343:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98626fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ea0 expref: 53 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.174362:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ea0 expref: 52 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.174371:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:0.0:1787847424.174373:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787847424.174376:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affc00, rc 0) 00000100:00100000:0.0:1787847424.174446:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11474:x1874693595408384:12345-192.168.201.21@tcp:101:cat.0 Request processed in 464us (1336us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787847424.174453:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 167 00000100:00100000:1.0:1787847424.215092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.215218:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595408512 00000100:00100000:3.0:1787847424.215228:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595408512 00000100:00100000:3.0:1787847424.215279:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 168 00000100:00100000:3.0:1787847424.215288:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11475:x1874693595408512:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847424.215311:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.215330:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862711 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ea7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.215393:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.215425:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.215438:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847424.215623:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787847424.215628:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847424.215702:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.215733:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862711 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ea7 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.215754:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ea7 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.215762:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847424.215765:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847424.215768:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:3.0:1787847424.215841:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11475:x1874693595408512:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 553us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.215848:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 168 00000100:00100000:2.0:1787847424.225131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.225336:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595408896 00000100:00100000:3.0:1787847424.225345:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595408896 00000100:00100000:3.0:1787847424.225397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:3.0:1787847424.225405:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11475:x1874693595408896:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847424.225695:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11475:x1874693595408896:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 288us (570us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787847424.225718:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:1.0:1787847424.233325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.233454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409024 00000100:00100000:2.0:1787847424.233467:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409024 00000100:00100000:2.0:1787847424.233548:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1787847424.233581:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11475:x1874693595409024:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:2.0:1787847424.233605:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787847424.233635:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98626a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e8b expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.233661:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ea0 expref: 53 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.233677:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b98625b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e4c expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.233692:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361200) 00010000:00010000:2.0:1787847424.233705:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847424.233821:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:11475:x1874693595409024:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 243us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847424.233829:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:1.0:1787847424.241493:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.241607:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409152 00000100:00100000:0.0:1787847424.241619:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409152 00000100:00100000:0.0:1787847424.241739:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 169 00000100:00100000:0.0:1787847424.241751:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:11475:x1874693595409152:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:0.0:1787847424.241862:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.241879:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.241897:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787847424.242166:0:7214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787847424.242276:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:11475:x1874693595409152:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 526us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.242284:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 169 00000040:00080000:1.0:1787847424.279213:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847424.279222:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847424.279283:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787847424.279292:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787847424.279425:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616380032:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787847424.279536:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33540 going to sleep for 11 seconds 00000100:00100000:3.0:1787847424.287442:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616380032:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787847424.289303:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.289425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409280 00000100:00100000:3.0:1787847424.289435:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409280 00000100:00100000:3.0:1787847424.289550:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 170 00000100:00100000:3.0:1787847424.289561:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:11477:x1874693595409280:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847424.289586:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.289609:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0eae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.289676:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.289691:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.289703:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.289718:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.289726:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.289732:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290108:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290124:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290132:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847424.290166:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787847424.290171:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847424.290186:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290197:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290205:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290211:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290217:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290222:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165dc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.290226:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290233:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290244:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847424.290247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847424.290257:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290263:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986272d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290277:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290283:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290289:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290294:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.290297:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290302:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290310:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c3361700) 00010000:00010000:3.0:1787847424.290313:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847424.290315:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290321:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290351:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290378:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.290386:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:3.0:1787847424.290389:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847424.290392:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:3.0:1787847424.290768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11477:x1874693595409280:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1206us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.290777:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 170 00000100:00100000:1.0:1787847424.299624:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.299727:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409408 00000100:00100000:3.0:1787847424.299738:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409408 00000100:00100000:3.0:1787847424.299799:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 171 00000100:00100000:3.0:1787847424.299810:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11479:x1874693595409408:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787847424.299844:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787847424.299994:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11479:x1874693595409408:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 186us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.300002:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 171 00000100:00100000:2.0:1787847424.317555:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.317654:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409536 00000100:00100000:0.0:1787847424.317665:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409536 00000100:00100000:0.0:1787847424.317728:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 172 00000100:00100000:0.0:1787847424.317739:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11479:x1874693595409536:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787847424.317813:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317833:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317845:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317872:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317880:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317887:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317914:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317922:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.317974:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847424.318027:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787847424.318031:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847424.318043:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318054:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318060:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318067:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318073:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847424.318076:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318083:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318095:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:0.0:1787847424.318098:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847424.318103:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318109:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b9862742 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318122:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318139:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318145:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318150:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847424.318154:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318160:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318168:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d87c7207800) 00010000:00010000:0.0:1787847424.318171:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847424.318174:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318180:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862749 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318193:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318199:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318205:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318209:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847424.318218:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318224:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318232:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:0.0:1787847424.318234:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847424.318237:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.318243:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.318310:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11479:x1874693595409536:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 573us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.318319:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 172 00000100:00100000:1.0:1787847424.325635:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.325765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409792 00000100:00100000:3.0:1787847424.325776:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409792 00000100:00100000:3.0:1787847424.325830:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 173 00000100:00100000:3.0:1787847424.325841:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11479:x1874693595409792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.325873:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.325907:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862757 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0eb5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326066:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326082:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326094:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847424.326108:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787847424.326206:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326214:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326220:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326226:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.326230:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326236:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326248:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:3.0:1787847424.326250:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847424.326255:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326271:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b986275e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326313:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862757 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eb5 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326325:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:3.0:1787847424.326327:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847424.326330:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862757 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eb5 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.326340:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d200, rc 0) 00000100:00100000:3.0:1787847424.326421:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11479:x1874693595409792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 582us (795us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787847424.326429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 173 00000100:00100000:1.0:1787847424.338843:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.338919:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595409920 00000100:00100000:3.0:1787847424.338982:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595409920 00000100:00100000:3.0:1787847424.339033:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 174 00000100:00100000:3.0:1787847424.339044:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11479:x1874693595409920:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787847424.339083:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787847424.339200:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11479:x1874693595409920:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.339208:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 174 00000100:00100000:2.0:1787847424.352696:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.354655:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595410176 00000100:00100000:0.0:1787847424.354670:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595410176 00000100:00100000:2.0:1787847424.358345:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 175 00000100:00100000:2.0:1787847424.358363:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11479:x1874693595410176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847424.358390:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847424.358393:0:7214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787847424.358430:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ea7 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.358454:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:2.0:1787847424.358476:0:7214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847424.358492:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b986276c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ebc expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787847424.359785:0:7214:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787847424.360063:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.360083:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.360094:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.360159:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b986276c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ebc expref: 55 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.360177:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ebc expref: 54 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.360184:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c4d7ff00) 00010000:00010000:2.0:1787847424.360187:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847424.360191:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847424.360275:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11479:x1874693595410176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1916us (7589us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787847424.360284:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 175 00000100:00100000:1.0:1787847424.368603:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.368762:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595410432 00000100:00100000:3.0:1787847424.368773:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595410432 00000100:00100000:3.0:1787847424.368900:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 176 00000100:00100000:3.0:1787847424.368927:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11479:x1874693595410432:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.369029:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847424.369058:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ebc expref: 54 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369079:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c4d7ff00) 00010000:00010000:3.0:1787847424.369091:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847424.369114:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369127:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369136:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369150:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369157:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369164:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369425:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369433:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369452:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369458:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.369462:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369469:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369478:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847424.369482:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847424.369485:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369492:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862781 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369504:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369510:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369515:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369520:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.369523:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369540:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369549:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd8572c13 (ffff8d87c3361700) 00010000:00010000:3.0:1787847424.369551:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847424.369555:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.369574:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd8572c13 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.369665:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11479:x1874693595410432:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 740us (1070us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787847424.369673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 176 00000100:00100000:0.0:1787847424.375236:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.375314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595410560 00000100:00100000:3.0:1787847424.375323:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595410560 00000100:00100000:3.0:1787847424.375387:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 177 00000100:00100000:3.0:1787847424.375398:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+53:11479:x1874693595410560:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.375421:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.375445:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986278f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ec3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.375480:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.375493:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.375505:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.375624:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b986278f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.375645:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.375653:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847424.375657:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787847424.375660:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:3.0:1787847424.375727:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11479:x1874693595410560:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 331us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.375734:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 177 00000100:00100000:2.0:1787847424.378498:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.378667:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595410816 00000100:00100000:0.0:1787847424.378678:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595410816 00000100:00100000:0.0:1787847424.378738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 178 00000100:00100000:0.0:1787847424.378749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11479:x1874693595410816:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787847424.378856:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.378871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.378882:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787847424.379231:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787847424.379242:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339203309629ns, next at 340203306835ns, rc = 0 00000004:00010000:0.0:1787847424.379336:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000958517f4 reply state 0000000024afe562 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.379346:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787847424.379687:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:11479:x1874693595410816:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 936us (1194us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787847424.379696:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 178 00010000:00010000:3.0:1787847424.381882:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.381899:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.381907:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.381913:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.381918:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.381925:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.381984:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847424.382002:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787847424.382009:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.382016:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b986279d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847424.384039:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.384411:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595410944 00000100:00100000:3.0:1787847424.384421:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595410944 00000100:00100000:3.0:1787847424.384491:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 179 00000100:00100000:3.0:1787847424.384502:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:11479:x1874693595410944:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.384527:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.384553:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0eca expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.384609:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.384623:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.384640:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847424.384643:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847424.384646:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847424.384709:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:11479:x1874693595410944:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 209us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.384716:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 179 00000100:00100000:0.0:1787847424.387453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.387640:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595411072 00000100:00100000:2.0:1787847424.387663:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595411072 00000100:00100000:2.0:1787847424.387758:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:2.0:1787847424.387770:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595411072:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787847424.388136:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595411072:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 368us (692us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787847424.388144:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:0.0:1787847424.391108:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.391192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595411328 00000100:00100000:3.0:1787847424.391201:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595411328 00000100:00100000:3.0:1787847424.391276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:3.0:1787847424.391287:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:11479:x1874693595411328:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787847424.391688:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11479:x1874693595411328:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 402us (590us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787847424.391697:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:0.0:1787847424.396050:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.396185:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595411584 00000100:00100000:3.0:1787847424.396196:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595411584 00000100:00100000:3.0:1787847424.396258:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 180 00000100:00100000:3.0:1787847424.396269:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11479:x1874693595411584:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787847424.396404:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11479:x1874693595411584:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 136us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.396413:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 180 00000100:00100000:0.0:1787847424.399011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.399137:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595411712 00000100:00100000:3.0:1787847424.399148:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595411712 00000100:00100000:3.0:1787847424.399209:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 181 00000100:00100000:3.0:1787847424.399219:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11479:x1874693595411712:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.399241:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.399264:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98627ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ed1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.399342:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98627b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.399371:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98627b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.399384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98627b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847424.399438:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847424.399458:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98627b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.399494:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b98627ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed1 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.399514:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98627b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed1 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.399522:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847424.399525:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787847424.399528:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6400, rc 0) 00000100:00100000:3.0:1787847424.399594:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11479:x1874693595411712:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 376us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.399602:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 181 00000100:00100000:2.0:1787847424.404815:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.405021:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595411840 00000100:00100000:0.0:1787847424.405031:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595411840 00000100:00100000:0.0:1787847424.405089:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:0.0:1787847424.405099:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595411840:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847424.405116:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847424.405138:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ed8 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787847424.405164:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a906300, blocks: 0x1 00010000:00010000:0.0:1787847424.405183:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787847424.405189:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847424.405198:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.405238:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.405251:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:0.0:1787847424.407294:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9bf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595411840:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2185us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.407308:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:0.0:1787847424.418725:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.418861:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412096 00000100:00100000:3.0:1787847424.418872:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412096 00000100:00100000:3.0:1787847424.418968:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 182 00000100:00100000:3.0:1787847424.418980:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f99aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11479:x1874693595412096:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787847424.419089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f99aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11479:x1874693595412096:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 110us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.419096:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 182 00000100:00100000:2.0:1787847424.426446:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.426583:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412224 00000100:00100000:3.0:1787847424.426593:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412224 00000100:00100000:3.0:1787847424.426692:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:3.0:1787847424.426716:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:11479:x1874693595412224:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.426735:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847424.426752:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0edf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.426782:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 9 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.426791:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847424.426796:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847424.426801:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.426836:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 9 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.426850:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 9 pid: 6677 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.426864:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874693616380160:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847424.426992:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847424.432324:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847424.432396:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412352 00000100:00100000:1.0:1787847424.432416:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412352 00010000:00010000:1.0:1787847424.432451:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 10 pid: 6677 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.432498:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:1.0:1787847424.432508:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595412352:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847424.432524:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847424.432548:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 10 pid: 6677 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.432562:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 10 pid: 6677 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.432586:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847424.432590:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847424.432599:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.432610:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.432645:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 10 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.432658:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1874693616380288:192.168.201.21@tcp:105: 00000100:00100000:1.0:1787847424.432727:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787847424.433133:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b98627b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed8 expref: 10 pid: 6677 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.433149:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880052da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6679:1874693616380160:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847424.433171:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 9 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.433182:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6000, rc 0) 00000100:00100000:0.0:1787847424.433223:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:11479:x1874693595412224:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 6510us (6861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.433232:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:3.0:1787847424.443783:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1874693616380288:192.168.201.21@tcp:105: 00010000:00010000:3.0:1787847424.443808:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847424.443861:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595412352:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 11354us (11545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.443882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:3.0:1787847424.445471:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.445611:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412480 00000100:00100000:2.0:1787847424.445620:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412480 00002000:00100000:2.0:1787847424.445682:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d880052c3c0 x1874693595412480/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:640/0 lens 504/0 e 0 to 0 dl 1787847435 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847424.445693:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d880052c3c0 with x1874693595412480 ext(0->8) 00002000:00010000:2.0:1787847424.445699:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d880052c3c0 00000100:00100000:2.0:1787847424.445733:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:2.0:1787847424.445742:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2344:x1874693595412480:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787847424.446275:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2344:x1874693595412480:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 530us (920us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787847424.446284:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00002000:00100000:2.0:1787847424.446291:0:6684:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d880052c3c0 x1874693595412480/t4294967314(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:640/0 lens 504/448 e 0 to 0 dl 1787847435 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847424.446300:0:6684:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d880052c3c0 with x1874693595412480 ext(0->8) 00002000:00010000:2.0:1787847424.446304:0:6684:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d880052c3c0 00000100:00100000:3.0:1787847424.451157:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.451266:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412608 00000100:00100000:2.0:1787847424.451276:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412608 00000100:00100000:2.0:1787847424.451838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 183 00000100:00100000:2.0:1787847424.451852:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11479:x1874693595412608:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1787847424.475056:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847424.520863:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11479:x1874693595412608:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 69002us (69705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.520879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 183 00000001:00080000:0.0:1787847424.520918:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1787847424.520980:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787847424.521018:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d87deaed180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787847424.521023:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efbc3500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d87deaeda80 00000020:00080000:0.0:1787847424.521026:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efbc3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87c503f000 00000004:00080000:0.0:1787847424.521039:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000001:00080000:0.0:1787847424.521072:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1787847424.521098:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787847424.521332:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1787847424.521516:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1787847424.521579:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616380416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787847424.521632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847424.521676:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847424.521683:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616380544:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787847424.521706:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847424.521737:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616380416 00000100:00100000:0.0:1787847424.521744:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616380416 00000100:00100000:0.0:1787847424.521792:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616380544 00000100:00100000:0.0:1787847424.521795:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616380544 00000100:00100000:0.0:1787847424.521813:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787847424.521822:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616380416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787847424.521995:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787847424.521999:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787847424 00002000:00010000:0.0:1787847424.522001:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787847424.522003:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787847424 -> 1787847424 00002000:00010000:0.0:1787847424.522006:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787847424.522045:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616380416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (412us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787847424.522067:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787847424.522083:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787847424.522090:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616380544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787847424.522104:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787847424.522129:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9062fe, atime: 0x6a9062fe, ctime: 0x6a9062fe, blocks: 0x1 00010000:00010000:0.0:1787847424.522137:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522154:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1787847424.522159:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847424.522166:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522182:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522192:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522200:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522218:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787847424.522638:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3300:x1874693616380544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 547us (929us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787847424.522645:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787847424.522677:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787847424.522690:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847424.522696:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522706:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847424.522711:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522721:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522742:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522750:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdfa5c1e/0x1835de88b98627c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.522768:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847424.522770:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847424.522771:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787847424.522806:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87f9ce1680/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787847424.522813:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616380544:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1787847424.522825:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87f9ce12c0/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787847424.522829:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616380416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787847424.529682:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.529807:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412736 00000100:00100000:2.0:1787847424.529817:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412736 00000100:00100000:2.0:1787847424.529875:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:2.0:1787847424.529885:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595412736:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787847424.604088:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1787847424.604107:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1787847424.605676:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595412736:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 75782us (75991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847424.605689:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:3.0:1787847424.618609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847424.619251:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595412992 00000100:00100000:1.0:1787847424.619262:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595412992 00000100:00100000:1.0:1787847424.619327:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 184 00000100:00100000:1.0:1787847424.619338:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:11479:x1874693595412992:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787847424.619406:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847424.619439:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98627b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ed1 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.619458:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:1.0:1787847424.619464:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787847424.619606:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.619621:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.619631:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787847424.619880:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c172b4b reply state 000000003793ef27 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.619890:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787847424.620301:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11479:x1874693595412992:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 963us (1699us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787847424.620309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 184 00000100:00100000:1.0:1787847424.623405:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.623473:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595413120 00000100:00100000:0.0:1787847424.623497:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595413120 00000100:00100000:0.0:1787847424.623562:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1787847424.623572:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595413120:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787847424.623834:0:7920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787847424.623838:0:7920:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787847424 -> 1787847424 00002000:00010000:0.0:1787847424.623840:0:7920:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787847422 00002000:00010000:0.0:1787847424.623843:0:7920:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787847424 -> 1787847424 00002000:00010000:0.0:1787847424.623845:0:7920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787847424.623898:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595413120:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 326us (501us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787847424.623905:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00010000:00010000:3.0:1787847424.624017:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.624027:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.624034:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.624040:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847424.624045:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.624053:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.624068:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847424.624071:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847424.624075:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.624082:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98627ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.630914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.631500:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595413376 00000100:00100000:2.0:1787847424.631510:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595413376 00000100:00100000:2.0:1787847424.631576:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 185 00000100:00100000:2.0:1787847424.631587:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:11479:x1874693595413376:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787847424.631656:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.631672:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.631682:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.631716:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.631731:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 18 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847424.631766:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aa580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616380672:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847424.631864:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847424.639344:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.639427:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595413504 00000100:00100000:3.0:1787847424.639436:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595413504 00010000:00010000:3.0:1787847424.639490:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.639533:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:3.0:1787847424.639543:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:2347:x1874693595413504:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847424.639558:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847424.639565:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.639580:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.639604:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:3.0:1787847424.639610:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.639620:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.639628:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.639647:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847424.639696:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:2347:x1874693595413504:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 155us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.639703:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00010000:00010000:1.0:1787847424.640008:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ec3 expref: 18 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.640037:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aa580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616380672:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847424.640059:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640068:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640073:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640102:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640109:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640115:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640120:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847424.640124:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640131:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640140:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:1.0:1787847424.640143:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787847424.640147:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.640159:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98627d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.640208:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+17:11479:x1874693595413376:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 8623us (9300us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787847424.640216:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 185 00000100:00100000:1.0:1787847424.651743:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.655634:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595413632 00000100:00100000:0.0:1787847424.655649:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595413632 00000100:00100000:0.0:1787847424.655708:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:0.0:1787847424.655718:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2344:x1874693595413632:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787847424.655762:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.655784:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.655793:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847424.655798:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787847424.655803:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.655857:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.655872:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 8 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.655887:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616380800:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847424.655997:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed780 going to sleep for 11 seconds 00000100:00100000:1.0:1787847424.666647:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce03c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616380800:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847424.666742:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.670053:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847424.670267:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595413760 00000100:00100000:3.0:1787847424.670276:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595413760 00010000:00010000:3.0:1787847424.670313:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 9 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.670416:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:3.0:1787847424.670427:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2346:x1874693595413760:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847424.670444:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847424.670469:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 9 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.670484:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 9 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.670508:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000493e7330/0x1835de88b98627c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0edf expref: 9 pid: 6679 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.670525:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847424.670529:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847424.670535:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.670544:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.670572:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847424.670626:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595413760:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 200us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.670647:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00010000:00010000:0.0:1787847424.671022:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671032:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671058:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671066:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671074:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671081:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847424.671093:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671103:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671116:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.671123:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025405cc8/0x1835de88b98627dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.671449:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2344:x1874693595413632:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 15730us (19713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.671459:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:1.0:1787847424.674666:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847424.674702:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595414016 00000100:00100000:1.0:1787847424.674710:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595414016 00000001:00080000:0.0:1787847424.674735:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1787847424.674749:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1787847424.674768:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 186 00000100:00100000:1.0:1787847424.674778:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+17:11479:x1874693595414016:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787847424.674851:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.674869:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.674880:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.675099:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.675115:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.675124:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.675153:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.675166:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 18 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847424.675180:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616380928:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847424.675265:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1254300 going to sleep for 11 seconds 00000100:00100000:0.0:1787847424.682203:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616380928:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847424.682232:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.682807:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847424.683023:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595414144 00000100:00100000:0.0:1787847424.683031:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595414144 00010000:00010000:0.0:1787847424.683067:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.683102:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:0.0:1787847424.683112:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:2346:x1874693595414144:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847424.683140:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847424.683148:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683161:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683185:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b98627a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eca expref: 19 pid: 5845 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683200:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:0.0:1787847424.683206:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683215:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683222:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683245:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847424.683294:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2346:x1874693595414144:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 183us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.683302:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00010000:00010000:0.0:1787847424.683409:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.683417:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847424.683606:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787847424.683762:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787847424.683808:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787847424.683886:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874693616381056:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787847424.683968:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847424.683994:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847424.684015:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616381056 00000100:00100000:0.0:1787847424.684019:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616381056 00000100:00100000:0.0:1787847424.684053:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787847424.684061:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874693616381056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787847424.684127:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874693616381056:12345-0@lo:1000:mdt00_000.0 Request processed in 66us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847424.684134:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787847424.684169:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1787847424.684175:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87f9ce12c0, transno 4294967315 00000100:00100000:0.0:1787847424.684187:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874693616381056:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1787847424.684624:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787847424.684673:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874693616381184:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787847424.684703:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847424.684722:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed780 going to sleep for 11 seconds 00000100:00100000:0.0:1787847424.684896:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616381184 00000100:00100000:0.0:1787847424.684901:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616381184 00000100:00100000:0.0:1787847424.684973:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787847424.684982:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1874693616381184:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787847424.685124:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1874693616381184:12345-0@lo:1000:mdt00_000.0 Request processed in 143us (419us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787847424.685140:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787847424.685177:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1874693616381184:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1787847424.685205:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685215:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685222:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685228:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847424.685233:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685240:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685255:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87c3361900) 00010000:00010000:0.0:1787847424.685258:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787847424.685263:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685270:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98627ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685298:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685305:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685323:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685329:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847424.685332:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685338:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685347:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:0.0:1787847424.685350:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787847424.685352:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685358:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986271f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685379:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685393:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685401:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685422:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847424.685448:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 21 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847424.685460:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616381312:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847424.685518:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d3ce7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787847424.690121:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.690568:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce12c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616381312:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847424.690596:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.690685:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595414272 00000100:00100000:3.0:1787847424.690691:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595414272 00010000:00010000:3.0:1787847424.690730:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 22 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847424.690812:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:3.0:1787847424.690822:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:2347:x1874693595414272:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847424.690837:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847424.690843:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 22 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.690867:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 22 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.690891:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986273b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eae expref: 22 pid: 5843 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.690906:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:3.0:1787847424.690911:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.690920:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.690928:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.690978:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847424.691040:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:2347:x1874693595414272:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 218us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847424.691048:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 71 00010000:00010000:2.0:1787847424.691707:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691718:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691731:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691737:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691743:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691750:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847424.691753:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691760:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.691771:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:2.0:1787847424.692022:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847424.692028:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692034:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98627f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692047:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692053:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692058:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692062:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847424.692065:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692070:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692078:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c7207e00) 00010000:00010000:2.0:1787847424.692080:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787847424.692083:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847424.692089:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b98627e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847424.692307:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11479:x1874693595414016:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 17527us (17657us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787847424.692324:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 186 00000020:00080000:2.0:1787847424.692330:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787847424.693493:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787847424.693500:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787847424.694024:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787847424.694033:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787847424.695197:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847424.695277:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595414528 00000100:00100000:2.0:1787847424.695285:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595414528 00000100:00100000:2.0:1787847424.695375:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:2.0:1787847424.695387:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11479:x1874693595414528:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787847424.696417:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787847424.696759:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1787847424.696821:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.696840:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.696852:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.696861:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.696868:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.696878:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847424.696894:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787847424.696914:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847424.696921:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.696927:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4200 already unused, calling callback (ffffffffc1555440) 00000100:00100000:1.0:1787847424.697021:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:11479:x1874693595414528:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 1632us (1828us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1787847424.697030:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000020:00080000:1.0:1787847424.697036:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787847424.697777:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.697790:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.697806:0:7621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d87e122eb00) 00010000:00010000:3.0:1787847424.697809:0:7621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787847424.697814:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.697820:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98627f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847424.697840:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847424.697842:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847424.697844:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787847425.013906:0:12457:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847425.013915:0:12457:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847425.014610:0:12457:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787847425.014619:0:12457:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787847425.116326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.116400:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595414784 00000100:00100000:3.0:1787847425.116409:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595414784 00000100:00080000:2.0:1787847425.116535:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847425.116607:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 187 00000100:00100000:3.0:1787847425.116619:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:11498:x1874693595414784:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847425.116659:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847425.116679:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98627ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ee6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.116968:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862806 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.116983:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.116995:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862806 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847425.117006:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787847425.117187:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98627ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ee6 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.117205:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862806 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ee6 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.117213:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847425.117217:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847425.117220:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6000, rc 0) 00000100:00100000:3.0:1787847425.117291:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11498:x1874693595414784:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 675us (975us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787847425.117299:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 187 00000100:00100000:2.0:1787847425.121276:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.121369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595414912 00000100:00100000:3.0:1787847425.121379:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595414912 00000100:00100000:3.0:1787847425.121469:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 188 00000100:00100000:3.0:1787847425.121488:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11498:x1874693595414912:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:3.0:1787847425.121563:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121579:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121591:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121605:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121612:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121618:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121910:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121919:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.121926:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847425.122006:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122019:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122031:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122039:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122045:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.122049:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122057:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122069:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847425.122073:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.122078:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122084:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122098:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122103:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122108:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122114:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.122123:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122130:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122138:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c3361700) 00010000:00010000:3.0:1787847425.122140:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.122143:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122149:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986281b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122164:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122170:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122176:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122181:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.122184:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122189:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122197:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847425.122198:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.122208:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.122214:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.122285:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11498:x1874693595414912:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 798us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.122294:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 188 00000100:00100000:3.0:1787847425.156998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.157041:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595415168 00000100:00100000:1.0:1787847425.157052:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595415168 00000100:00100000:1.0:1787847425.157157:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 189 00000100:00100000:1.0:1787847425.157169:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11501:x1874693595415168:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847425.157192:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847425.157212:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862829 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0eed expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157285:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157301:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157312:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157340:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157348:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157355:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157671:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157681:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157688:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847425.157699:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787847425.157791:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157799:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157805:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157811:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.157816:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157844:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157856:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:1.0:1787847425.157859:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847425.157863:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157869:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157881:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157887:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157893:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157898:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.157901:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157906:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157914:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87e122ea00) 00010000:00010000:1.0:1787847425.157916:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847425.157919:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.157968:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.158010:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862829 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 27 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.158024:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 26 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.158032:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:1.0:1787847425.158034:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787847425.158036:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5200, rc 0) 00000100:00100000:1.0:1787847425.158099:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11501:x1874693595415168:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 931us (1110us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787847425.158107:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 189 00000100:00100000:3.0:1787847425.162084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.162259:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595415296 00000100:00100000:1.0:1787847425.162269:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595415296 00000100:00100000:1.0:1787847425.162365:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 190 00000100:00100000:1.0:1787847425.162377:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11501:x1874693595415296:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:1.0:1787847425.162448:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162464:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162476:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162516:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162810:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162817:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162833:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5c00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.162838:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162846:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162860:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:1.0:1787847425.162863:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787847425.162868:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.162875:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b986284c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.162980:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11501:x1874693595415296:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 605us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847425.162989:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 190 00000100:00100000:2.0:1787847425.179513:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.179556:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595415552 00000100:00100000:2.0:1787847425.179565:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595415552 00000100:00100000:2.0:1787847425.179620:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:2.0:1787847425.179629:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11501:x1874693595415552:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1787847425.179873:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:11501:x1874693595415552:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 244us (442us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787847425.179881:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:3.0:1787847425.207859:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.207907:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595415808 00000100:00100000:0.0:1787847425.207918:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595415808 00000100:00100000:0.0:1787847425.208013:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 191 00000100:00100000:0.0:1787847425.208025:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:11034:x1874693595415808:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847425.208052:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847425.208075:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9862853 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0ef4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.208185:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.208201:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 28 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.208211:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.208246:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 28 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.208280:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 28 pid: 7214 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.208293:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616381440:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847425.208390:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c60e1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787847425.210455:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616381440:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847425.210485:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.210923:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.211025:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595415936 00000100:00100000:0.0:1787847425.211033:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595415936 00010000:00010000:0.0:1787847425.211069:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 29 pid: 7214 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.211108:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:0.0:1787847425.211119:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:2346:x1874693595415936:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847425.211134:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847425.211141:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 29 pid: 7214 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.211155:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 29 pid: 7214 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.211180:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986283e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0eed expref: 29 pid: 7214 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.211216:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:0.0:1787847425.211222:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.211231:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.211239:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.211269:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847425.211327:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:2346:x1874693595415936:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 208us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.211334:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00010000:00010000:1.0:1787847425.212062:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.212069:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847425.212090:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787847425.212203:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9862853 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.212214:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.212220:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:1.0:1787847425.212222:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787847425.212223:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:1.0:1787847425.212258:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11034:x1874693595415808:12345-192.168.201.21@tcp:101:bash.0 Request processed in 4234us (4407us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787847425.212265:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 191 00000100:00100000:3.0:1787847425.215093:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.215207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595416192 00000100:00100000:0.0:1787847425.215217:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595416192 00000100:00100000:0.0:1787847425.215276:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 192 00000100:00100000:0.0:1787847425.215286:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11034:x1874693595416192:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:0.0:1787847425.215840:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.215868:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.215881:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847425.216053:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787847425.216086:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055bcbeaa reply state 00000000af099ea6 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.216108:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787847425.216161:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787847425.216319:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11034:x1874693595416192:12345-192.168.201.21@tcp:36:bash.0 Request processed in 1032us (1235us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787847425.216328:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 192 00000020:00080000:0.0:1787847425.216334:0:5843:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787847425.218416:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.218441:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.218448:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.218453:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.218458:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.218465:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.218480:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:3.0:1787847425.218485:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.218503:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.218510:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9862868 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.219291:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.219542:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595416320 00000100:00100000:3.0:1787847425.219551:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595416320 00000100:00100000:3.0:1787847425.219608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 193 00000100:00100000:3.0:1787847425.219619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:11034:x1874693595416320:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847425.219640:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847425.219658:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b986286f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0efb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.219715:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b986286f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0efb expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.219729:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b986286f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0efb expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.219748:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:3.0:1787847425.219751:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847425.219754:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847425.219905:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11034:x1874693595416320:12345-192.168.201.21@tcp:101:bash.0 Request processed in 287us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.219913:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 193 00000100:00100000:2.0:1787847425.223819:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.223924:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595416448 00000100:00100000:0.0:1787847425.223973:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595416448 00000100:00100000:0.0:1787847425.224038:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:0.0:1787847425.224049:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:11034:x1874693595416448:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847425.224068:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847425.224088:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f02 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787847425.224115:0:7920:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a906300, atime: 0x6a9062fe, ctime: 0x6a906300, blocks: 0xb 00010000:00010000:0.0:1787847425.224137:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1787847425.224142:0:7920:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847425.224151:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 8 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.224169:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 8 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.224183:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affe00, rc 0) 00000100:00100000:0.0:1787847425.224243:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:11034:x1874693595416448:12345-192.168.201.21@tcp:101:bash.0 Request processed in 196us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.224267:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00080000:2.0:1787847425.224366:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847425.226386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.226589:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595416576 00000100:00100000:0.0:1787847425.226599:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595416576 00002000:00010000:0.0:1787847425.226637:0:6682:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787847425.226643:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d880036bc00 with x1874693595416576 ext(0->18446744073709551615) 00002000:00010000:0.0:1787847425.226654:0:6682:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d880036bc00. 00000100:00100000:0.0:1787847425.226726:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:0.0:1787847425.226736:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2344:x1874693595416576:12345-192.168.201.21@tcp:10:bash.0 00002000:00010000:0.0:1787847425.227038:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787847425.227043:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787847424 -> 1787847425 00002000:00010000:0.0:1787847425.227046:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787847422 -> 1787847422 00002000:00010000:0.0:1787847425.227048:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787847424 -> 1787847425 00002000:00010000:0.0:1787847425.227051:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787847425.227113:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2344:x1874693595416576:12345-192.168.201.21@tcp:10:bash.0 Request processed in 377us (734us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787847425.227121:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00002000:00010000:0.0:1787847425.227126:0:6682:0:(ofd_dev.c:2831:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787847425.227128:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d880036bc00 with x1874693595416576 ext(0->18446744073709551615) 00002000:00010000:0.0:1787847425.227133:0:6682:0:(ofd_dev.c:2836:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d880036bc00. 00000100:00100000:1.0:1787847425.291492:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.291636:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595416704 00000100:00100000:2.0:1787847425.291655:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595416704 00000100:00100000:2.0:1787847425.291797:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 194 00000100:00100000:2.0:1787847425.291809:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11515:x1874693595416704:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:2.0:1787847425.291905:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.291923:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.291982:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.291999:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292006:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292013:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292333:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292343:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292351:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847425.292391:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292403:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292416:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292423:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292429:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847425.292433:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292442:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292454:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:2.0:1787847425.292457:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847425.292461:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292467:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b986287d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292479:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292485:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292491:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292496:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847425.292505:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292511:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292519:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c4d7f700) 00010000:00010000:2.0:1787847425.292522:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847425.292525:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292531:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292545:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292551:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292557:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292562:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847425.292565:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292571:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292579:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:2.0:1787847425.292581:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847425.292591:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.292598:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b986288b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847425.292692:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11515:x1874693595416704:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 884us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847425.292701:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 194 00000100:00100000:3.0:1787847425.362050:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.362752:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595416960 00000100:00100000:1.0:1787847425.362763:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595416960 00000100:00100000:1.0:1787847425.363017:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:1.0:1787847425.363029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+32:11518:x1874693595416960:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847425.363050:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847425.363084:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862892 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f09 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363155:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363169:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363197:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363212:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363220:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363227:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363636:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98628a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363723:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98628a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.363731:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98628a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847425.363743:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787847425.364022:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364032:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364038:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364044:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.364055:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364062:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364075:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:1.0:1787847425.364078:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847425.364083:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364089:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b9862899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364101:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364107:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364113:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364118:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.364121:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364128:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364135:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87e122ea00) 00010000:00010000:1.0:1787847425.364137:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847425.364146:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364153:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b98628a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364197:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862892 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f09 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364212:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98628a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f09 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.364220:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:1.0:1787847425.364222:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787847425.364225:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5c00, rc 0) 00000100:00100000:1.0:1787847425.364308:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:11518:x1874693595416960:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1280us (2266us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787847425.364317:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 195 00000100:00100000:3.0:1787847425.368124:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.368228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595417088 00000100:00100000:0.0:1787847425.368236:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595417088 00000100:00100000:0.0:1787847425.368324:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 196 00000100:00100000:0.0:1787847425.368332:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:11518:x1874693595417088:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1787847425.368401:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.368439:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.368451:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.368482:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.368493:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 34 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.368506:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616381568:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847425.368590:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0dde000 going to sleep for 11 seconds 00000100:00100000:3.0:1787847425.371649:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.371729:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595417344 00000100:00100000:2.0:1787847425.371739:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595417344 00000100:00100000:2.0:1787847425.371808:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:2.0:1787847425.371828:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:5585:x1874693595417344:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787847425.372159:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:5585:x1874693595417344:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 341us (525us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787847425.372165:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:0.0:1787847425.373071:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616381568:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847425.373093:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847425.374297:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.374385:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595417472 00000100:00100000:0.0:1787847425.374394:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595417472 00010000:00010000:0.0:1787847425.374560:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 36 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.374601:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:0.0:1787847425.374611:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:2347:x1874693595417472:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847425.374627:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847425.375021:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 36 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.375036:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 36 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.375060:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986285a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ef4 expref: 36 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.375076:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:0.0:1787847425.375081:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.375090:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.375099:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.375170:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847425.375223:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:2347:x1874693595417472:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 612us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.375231:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00010000:00010000:2.0:1787847425.377236:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377252:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377361:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377369:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377377:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377398:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847425.377402:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377409:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377425:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:2.0:1787847425.377428:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847425.377433:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.377439:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affc00/0x1835de88b98628b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847425.377549:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:11518:x1874693595417088:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 9202us (9417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847425.377561:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 196 00000100:00100000:2.0:1787847425.383493:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.384639:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595417728 00000100:00100000:1.0:1787847425.384652:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595417728 00000100:00100000:1.0:1787847425.384722:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:1.0:1787847425.384731:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+34:11518:x1874693595417728:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1787847425.385004:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11518:x1874693595417728:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 273us (1521us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787847425.385013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00010000:00010000:3.0:1787847425.497296:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847425.506130:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.506349:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595417984 00000100:00100000:2.0:1787847425.506363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595417984 00000100:00100000:2.0:1787847425.506443:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:2.0:1787847425.506455:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+35:11529:x1874693595417984:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1787847425.506500:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847425.506529:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f10 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.506628:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.506662:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.506676:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.506695:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.506702:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.506710:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507138:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507149:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507158:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847425.507169:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787847425.507275:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507284:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507292:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507304:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847425.507310:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507319:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507335:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:2.0:1787847425.507338:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847425.507342:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507350:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507363:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507370:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507377:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507382:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847425.507385:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507391:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507406:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c4d7f700) 00010000:00010000:2.0:1787847425.507409:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847425.507412:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507418:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507467:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f10 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507480:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f10 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.507489:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:2.0:1787847425.507491:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847425.507494:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ac00, rc 0) 00000100:00100000:2.0:1787847425.507588:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+37:11529:x1874693595417984:12345-192.168.201.21@tcp:101:cat.0 Request processed in 1135us (1473us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787847425.507596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 197 00000100:00100000:3.0:1787847425.513070:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.513257:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595418240 00000100:00100000:1.0:1787847425.513270:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595418240 00000100:00100000:1.0:1787847425.513380:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:1.0:1787847425.513407:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+37:11529:x1874693595418240:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:1.0:1787847425.513751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:11529:x1874693595418240:12345-192.168.201.21@tcp:35:cat.0 Request processed in 359us (695us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787847425.513760:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:3.0:1787847425.531029:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.531313:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595418496 00000100:00100000:2.0:1787847425.531327:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595418496 00000100:00100000:2.0:1787847425.531640:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 198 00000100:00100000:2.0:1787847425.531654:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:11530:x1874693595418496:12345-192.168.201.21@tcp:36:rm.0 00010000:00010000:2.0:1787847425.531743:0:7214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787847425.531780:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f10 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.531833:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b98628a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f09 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.531849:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b986286f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0efb expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.531875:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87e122e700) 00010000:00010000:2.0:1787847425.531890:0:7214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847425.531918:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.531989:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532002:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532019:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532028:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532035:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532443:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532465:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.532480:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787847425.534160:0:7214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1787847425.534177:0:7214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340358244655ns, next at 341358241393ns, rc = 0 00010000:00010000:3.0:1787847425.534263:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534280:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534291:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534300:0:7214:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534307:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534314:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534655:0:7214:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787847425.534690:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534696:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534703:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534719:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.534724:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534733:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534748:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c4d7f200) 00010000:00010000:3.0:1787847425.534752:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787847425.534757:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534764:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b800/0x1835de88b98628ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534785:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534791:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534797:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534802:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.534805:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534812:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534832:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847425.534835:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.534838:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.534844:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b98628df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847425.535304:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000987b5e6a reply state 0000000055f777ce transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.535320:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787847425.535472:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847425.535480:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.535487:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847425.535491:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.535497:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.535509:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d87c4d7f200) 00010000:00010000:2.0:1787847425.535511:0:7622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787847425.535515:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.535666:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98628f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.535689:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847425.535691:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847425.535693:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847425.535831:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+37:11530:x1874693595418496:12345-192.168.201.21@tcp:36:rm.0 Request processed in 4176us (4812us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787847425.535839:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 198 00010000:00010000:3.0:1787847425.539922:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.539979:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.539989:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.539996:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.540002:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.540011:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.540059:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c4d7f700) 00010000:00010000:3.0:1787847425.540063:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.540068:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.540075:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b98628e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.579091:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.579169:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595418752 00000100:00100000:2.0:1787847425.579183:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595418752 00000100:00100000:2.0:1787847425.579317:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 199 00000100:00100000:2.0:1787847425.579331:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+36:11536:x1874693595418752:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1787847425.579367:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847425.579416:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f17 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.579590:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.579608:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.579621:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.579637:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.579644:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847425.579651:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787847425.580920:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787847425.581183:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581200:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581210:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581253:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581261:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581268:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581275:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.581280:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581300:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581317:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847425.581320:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.581326:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581333:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a400/0x1835de88b9862902 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847425.581352:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000340fe746 reply state 000000000455225f transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.581363:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787847425.581405:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b98628fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581420:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.581428:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847425.581431:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847425.581434:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847425.581535:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:11536:x1874693595418752:12345-192.168.201.21@tcp:101:bash.0 Request processed in 2206us (2455us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787847425.581546:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 199 00010000:00010000:3.0:1787847425.585699:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.585736:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.585743:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.585750:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.585756:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.585766:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.585788:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c4d7f200) 00010000:00010000:3.0:1787847425.585791:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.585796:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.585803:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862909 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847425.586118:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.586207:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595418880 00000100:00100000:0.0:1787847425.586221:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595418880 00000100:00100000:0.0:1787847425.586311:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:0.0:1787847425.586329:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2346:x1874693595418880:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847425.586415:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847425.586440:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f1e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787847425.586550:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1787847425.586613:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847425.586643:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1787847425.586649:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847425.586671:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.586694:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 6 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.586709:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:0.0:1787847425.586781:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2346:x1874693595418880:12345-192.168.201.21@tcp:101:bash.0 Request processed in 459us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.586789:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1787847425.589313:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.589449:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595419008 00000100:00100000:1.0:1787847425.589511:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595419008 00000100:00100000:1.0:1787847425.589630:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:1.0:1787847425.589639:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:11536:x1874693595419008:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1787847425.589660:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847425.589683:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f25 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.589720:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.589728:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847425.589731:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847425.589735:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.589770:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.589783:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 7 pid: 6678 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.589795:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874693616381696:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847425.589907:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1254540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847425.592066:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.592368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595419136 00000100:00100000:0.0:1787847425.592378:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595419136 00010000:00010000:0.0:1787847425.592419:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 8 pid: 6678 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.592576:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1874693616381696:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847425.592610:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.592625:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5a00, rc 0) 00000100:00100000:1.0:1787847425.592688:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:11536:x1874693595419008:12345-192.168.201.21@tcp:101:bash.0 Request processed in 3049us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847425.592697:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:0.0:1787847425.592852:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1787847425.592863:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595419136:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847425.592885:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847425.592914:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 7 pid: 6678 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.592986:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 7 pid: 6678 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.593021:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b986291e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f1e expref: 7 pid: 6678 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.593038:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847425.593042:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847425.593052:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.593064:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.593103:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.593119:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6f37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1874693616381824:192.168.201.21@tcp:105: 00000100:00100000:0.0:1787847425.593185:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0dde000 going to sleep for 11 seconds 00000100:00100000:2.0:1787847425.595874:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.595980:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595419392 00000100:00100000:3.0:1787847425.595990:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595419392 00000100:00100000:3.0:1787847425.596045:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:3.0:1787847425.596056:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+38:11536:x1874693595419392:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:0.0:1787847425.596618:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6f37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5830:1874693616381824:192.168.201.21@tcp:105: 00010000:00010000:0.0:1787847425.596649:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847425.596726:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595419136:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3863us (4669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.596738:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:3.0:1787847425.597953:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:11536:x1874693595419392:12345-192.168.201.21@tcp:35:bash.0 Request processed in 1865us (2062us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787847425.597967:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:0.0:1787847425.624051:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616382080:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847425.624205:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616382592:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624233:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847425.624259:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787847425.624265:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87d3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616381952:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624297:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847425.624328:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616382464:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624364:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847425.624391:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e1362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616382336:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847425.624437:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847425.624443:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616382208:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847425.624630:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616381952 00000100:00100000:0.0:1787847425.624639:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616381952 00000100:00100000:0.0:1787847425.624698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787847425.624708:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616381952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624770:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3303:x1874693616381952:12345-0@lo:400:kworker.0 Request processed in 62us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.624778:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787847425.624836:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87d3c18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616381952:0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.624867:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616382592 00000100:00100000:0.0:1787847425.624871:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616382592 00000100:00100000:0.0:1787847425.624897:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616382336 00000100:00100000:0.0:1787847425.624900:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616382336 00000100:00100000:0.0:1787847425.624979:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787847425.624986:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616382592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.625026:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616382592:12345-0@lo:400:kworker.0 Request processed in 41us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.625032:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787847425.625045:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787847425.625051:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616382336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847425.625084:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616382336:12345-0@lo:400:kworker.0 Request processed in 34us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.625090:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787847425.625114:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1787847425.625121:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1787847425.625137:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87f9ce1680, transno 4294967307 00000100:00100000:0.0:1787847425.625150:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e1362580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616382336:0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625464:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616382080 00000100:00100000:3.0:1787847425.625479:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616382080 00000100:00100000:3.0:1787847425.625514:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616382464 00000100:00100000:3.0:1787847425.625517:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616382464 00000100:00100000:3.0:1787847425.625541:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616382208 00000100:00100000:3.0:1787847425.625544:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616382208 00000100:00100000:3.0:1787847425.625558:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787847425.625565:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616382080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625609:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616382080:12345-0@lo:400:kworker.0 Request processed in 45us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.625615:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787847425.625630:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787847425.625636:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616382464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625665:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874693616382464:12345-0@lo:400:kworker.0 Request processed in 29us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.625671:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787847425.625684:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787847425.625691:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616382208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625725:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616382208:12345-0@lo:400:kworker.0 Request processed in 35us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.625731:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787847425.625788:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1874693616382464:0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625799:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616382080:0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625812:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e13f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616382592:0@lo:400:kworker.0 00000100:00100000:3.0:1787847425.625863:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616382208:0@lo:400:kworker.0 00000100:00080000:2.0:1787847425.626492:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847425.731219:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.731358:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595419520 00000100:00100000:3.0:1787847425.731392:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595419520 00000100:00100000:3.0:1787847425.731639:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 200 00000100:00100000:3.0:1787847425.731652:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+39:11552:x1874693595419520:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847425.731685:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847425.731710:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986292c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f2c expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.731790:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.731807:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.731820:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847425.731900:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787847425.731904:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847425.731959:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.731988:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b986292c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f2c expref: 41 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.732009:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f2c expref: 40 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.732018:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847425.732170:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847425.732175:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6400, rc 0) 00000100:00100000:3.0:1787847425.732262:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:11552:x1874693595419520:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 612us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.732270:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 200 00000100:00100000:2.0:1787847425.735963:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.736070:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595419776 00000100:00100000:3.0:1787847425.736084:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595419776 00000100:00100000:3.0:1787847425.736159:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:3.0:1787847425.736172:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+40:11552:x1874693595419776:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847425.736201:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847425.736230:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b986293a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f33 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.736380:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.736399:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.736416:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847425.736429:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787847425.736896:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b986293a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f33 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.736920:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f33 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.736968:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847425.736971:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847425.736995:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847425.737090:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+42:11552:x1874693595419776:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 919us (1169us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787847425.737099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 201 00000100:00100000:2.0:1787847425.742219:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847425.742280:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.742486:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420160 00000100:00100000:3.0:1787847425.742499:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420160 00000100:00100000:3.0:1787847425.742588:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1787847425.742600:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+42:2347:x1874693595420160:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847425.742623:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847425.742659:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f33 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.742683:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847425.742688:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847425.742760:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+41:2347:x1874693595420160:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 162us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.742769:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:0.0:1787847425.744012:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420032 00000100:00100000:0.0:1787847425.744037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420032 00000100:00100000:0.0:1787847425.744097:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 202 00000100:00100000:0.0:1787847425.744107:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+41:11552:x1874693595420032:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847425.744137:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847425.744162:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986294f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.744288:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.744308:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.744357:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847425.744375:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787847425.744557:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b986294f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f3a expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.744576:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f3a expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.744585:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847425.744588:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787847425.744591:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afea00, rc 0) 00000100:00100000:0.0:1787847425.744670:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:11552:x1874693595420032:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 564us (2465us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787847425.744678:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 202 00000100:00100000:2.0:1787847425.755176:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.755374:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420288 00000100:00100000:0.0:1787847425.755388:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420288 00000100:00100000:0.0:1787847425.755474:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:0.0:1787847425.755486:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800178050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+6:2347:x1874693595420288:12345-192.168.201.21@tcp:1:lfs.0 00010000:00010000:0.0:1787847425.755551:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.755577:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.755587:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847425.755601:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787847425.755607:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.755657:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.755673:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 6 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.755689:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874693616382720:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847425.755815:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0dde900 going to sleep for 11 seconds 00000100:00100000:2.0:1787847425.760158:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.760260:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420416 00000100:00100000:3.0:1787847425.760273:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420416 00002000:00100000:3.0:1787847425.760354:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d87e13f2580 x1874693595420416/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:641/0 lens 504/0 e 0 to 0 dl 1787847436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787847425.760368:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e13f2580 with x1874693595420416 ext(0->8) 00010000:00010000:3.0:1787847425.760380:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 7 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.760399:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 7 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847425.760431:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87e13f2580 00000100:00100000:3.0:1787847425.760582:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:3.0:1787847425.760594:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595420416:12345-192.168.201.21@tcp:4:lfs.0 00000100:00100000:3.0:1787847425.761805:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13f2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2346:x1874693595420416:12345-192.168.201.21@tcp:4:lfs.0 Request processed in 1204us (1655us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787847425.761818:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00002000:00100000:3.0:1787847425.761829:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d87e13f2580 x1874693595420416/t4294967308(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:641/0 lens 504/448 e 0 to 0 dl 1787847436 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787847425.761838:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87e13f2580 with x1874693595420416 ext(0->8) 00010000:00010000:3.0:1787847425.761847:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 9 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.762116:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc6d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6678:1874693616382720:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847425.762149:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.762816:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 9 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847425.762826:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d87e13f2580 00000100:00100000:2.0:1787847425.766136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.766239:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420544 00000100:00100000:3.0:1787847425.766253:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420544 00010000:00010000:3.0:1787847425.766308:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 9 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.766422:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:3.0:1787847425.766435:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2347:x1874693595420544:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847425.766585:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787847425.766613:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787847425.766617:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787847426 00002000:00010000:3.0:1787847425.766619:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787847426 00002000:00010000:3.0:1787847425.766622:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787847426 00010000:00010000:3.0:1787847425.766629:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 9 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.766647:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 9 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.766676:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f25 expref: 9 pid: 6679 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.766697:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847425.766702:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847425.766709:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.766722:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.766823:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847425.766895:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008543c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595420544:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 461us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.766905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00010000:00010000:1.0:1787847425.768809:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.768833:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769154:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769166:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769176:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769185:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847425.769190:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769222:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769245:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.769254:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008d0a3d4/0x1835de88b9862964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.769693:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800178050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595420288:12345-192.168.201.21@tcp:1:lfs.0 Request processed in 14200us (14524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847425.769706:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:2.0:1787847425.774693:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.774787:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420800 00000100:00100000:1.0:1787847425.774800:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420800 00000100:00100000:1.0:1787847425.774881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:1.0:1787847425.774893:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+43:11552:x1874693595420800:12345-192.168.201.21@tcp:35:lfs.0 00000004:00010000:1.0:1787847425.775032:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f3a expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847425.775368:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787847425.775420:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787847425.776263:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787847425.776518:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.776546:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.776577:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.776628:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.776647:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 47 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.776666:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874693616382848:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847425.776790:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1254540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847425.780709:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.780796:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595420928 00000100:00100000:3.0:1787847425.780808:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595420928 00010000:00010000:3.0:1787847425.780870:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 48 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.781053:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:3.0:1787847425.781071:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:2347:x1874693595420928:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847425.781089:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847425.781098:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 48 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.781114:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 48 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.781145:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847425.781151:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.781162:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.781170:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.781193:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847425.781261:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+48:2347:x1874693595420928:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 195us (566us total) trans 0 rc 0/0 00010000:00010000:1.0:1787847425.782014:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862910 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f17 expref: 48 pid: 5844 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847425.782051:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5846:1874693616382848:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847425.782078:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.782089:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.782096:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847425.782268:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787847425.782794:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787847425.783007:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616382976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787847425.783189:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847425.783228:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c11ca0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847425.784881:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616382976 00000100:00100000:1.0:1787847425.784897:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616382976 00000100:00100000:1.0:1787847425.785014:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787847425.785248:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616382976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787847425.785425:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616382976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 182us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847425.785435:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787847425.785628:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8de00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616382976:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787847425.786286:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787847425.786393:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616383104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787847425.786823:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847425.786959:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616383104 00000100:00100000:2.0:1787847425.786968:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616383104 00000100:00100000:2.0:1787847425.787014:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787847425.787136:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1874693616383104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787847425.787351:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1874693616383104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 219us (902us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787847425.787709:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:3.0:1787847425.787762:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880084d780 going to sleep for 11 seconds 00000100:00100000:3.0:1787847425.787813:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5846:1874693616383104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787847425.788287:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787847425.788362:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.788373:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.788382:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.788390:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847425.788395:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.788415:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.788435:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847425.788438:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787847425.788444:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.788619:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b986296b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787847425.788876:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787847425.789121:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787847425.789135:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340613202696ns, next at 341613200214ns, rc = 0 00000001:00080000:0.0:1787847425.789143:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787847425.789184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:0.0:1787847425.789188:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787847425.789197:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f3a expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.789679:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:11552:x1874693595420800:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 14440us (14653us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787847425.789693:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00000020:00080000:0.0:1787847425.789701:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787847425.792703:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.792776:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595421056 00000100:00100000:3.0:1787847425.792790:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595421056 00000100:00100000:3.0:1787847425.792890:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:3.0:1787847425.792902:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+50:11552:x1874693595421056:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847425.792970:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847425.792999:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f41 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.793152:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f41 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.793170:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f41 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.793193:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847425.793197:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847425.793202:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847425.793273:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:11552:x1874693595421056:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 373us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.793281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 203 00000100:00100000:2.0:1787847425.793956:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787847425.799714:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.799819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595421312 00000100:00100000:3.0:1787847425.799833:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595421312 00000100:00100000:2.0:1787847425.800588:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:2.0:1787847425.800605:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+51:11552:x1874693595421312:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1787847425.801034:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11552:x1874693595421312:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 423us (1324us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787847425.801044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1787847425.892128:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847425.892216:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595421440 00000100:00100000:3.0:1787847425.892225:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595421440 00000100:00100000:3.0:1787847425.892288:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 204 00000100:00100000:3.0:1787847425.892297:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11562:x1874693595421440:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:3.0:1787847425.892391:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892406:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892417:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892430:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892437:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892443:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892530:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892537:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892542:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847425.892579:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892590:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892604:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892610:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892615:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.892619:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892636:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892648:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847425.892650:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.892655:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892661:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b9862979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892674:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892679:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892684:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892689:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.892697:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892703:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892710:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c3361100) 00010000:00010000:3.0:1787847425.892712:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.892714:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892720:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b9862980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892733:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892738:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892743:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892748:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847425.892750:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892756:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892762:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847425.892764:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847425.892771:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847425.892777:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9862987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847425.893177:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11562:x1874693595421440:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 558us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847425.893186:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 204 00000100:00100000:3.0:1787847425.940576:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.940792:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595421696 00000100:00100000:1.0:1787847425.940802:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595421696 00000100:00100000:1.0:1787847425.940897:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:1.0:1787847425.940909:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+52:11565:x1874693595421696:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:1.0:1787847425.940995:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847425.941016:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986298e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941094:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941108:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941119:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941136:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941158:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941165:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941300:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941309:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941317:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847425.941525:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787847425.941708:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941717:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941725:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941730:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.941734:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941741:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941763:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:1.0:1787847425.941766:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847425.941771:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941777:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862995 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941792:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941798:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941803:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941807:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847425.941811:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941816:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941823:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87e122ed00) 00010000:00010000:1.0:1787847425.941825:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847425.941828:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.941833:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b986299c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.942128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b986298e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.942142:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847425.942150:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847425.942152:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787847425.942154:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4000, rc 0) 00000100:00100000:1.0:1787847425.942210:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bda940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11565:x1874693595421696:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1304us (1644us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787847425.942219:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 205 00000100:00100000:1.0:1787847425.946767:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847425.946871:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595421824 00000100:00100000:0.0:1787847425.946894:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595421824 00000100:00100000:0.0:1787847425.947032:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 206 00000100:00100000:0.0:1787847425.947041:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11565:x1874693595421824:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1787847425.947108:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947124:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947135:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947158:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947164:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947170:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947176:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847425.947180:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947186:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947196:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847425.947199:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847425.947204:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847425.947218:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b98629b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847425.947284:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11565:x1874693595421824:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 244us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847425.947291:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 206 00000100:00100000:0.0:1787847425.950830:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847425.950986:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595422080 00000100:00100000:1.0:1787847425.950997:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595422080 00000100:00100000:1.0:1787847425.951046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:1.0:1787847425.951058:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+54:11565:x1874693595422080:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1787847425.951286:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:11565:x1874693595422080:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 230us (478us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787847425.951294:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:2.0:1787847426.031673:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.031815:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595422336 00000100:00100000:3.0:1787847426.031828:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595422336 00000100:00100000:3.0:1787847426.031917:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 207 00000100:00100000:3.0:1787847426.031969:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:11575:x1874693595422336:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847426.032002:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847426.032006:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787847426.032247:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b9862933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f2c expref: 55 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.032274:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847426.032280:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847426.032298:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98629b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f4f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.032439:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.032456:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.032491:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.032536:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.032553:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 55 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847426.032569:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616383232:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847426.032735:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efa953c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847426.038659:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.039601:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595422464 00000100:00100000:1.0:1787847426.039617:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595422464 00010000:00010000:1.0:1787847426.039680:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 56 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.039734:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:1.0:1787847426.039765:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:2346:x1874693595422464:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847426.039787:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847426.039795:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 56 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.039811:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 56 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.039841:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847426.039847:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.039874:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.039884:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.039910:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847426.040141:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+56:2346:x1874693595422464:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 376us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.040151:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00010000:00010000:3.0:1787847426.041594:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4000/0x1835de88b98629a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f48 expref: 55 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847426.041621:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdad00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616383232:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847426.041653:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.041663:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.041669:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847426.041697:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787847426.042520:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98629b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.042574:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.042583:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.042586:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847426.042590:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7600, rc 0) 00000100:00100000:3.0:1787847426.042676:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:11575:x1874693595422336:12345-192.168.201.21@tcp:101:bash.0 Request processed in 10710us (11016us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787847426.042686:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 207 00000100:00100000:3.0:1787847426.045984:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.046154:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595422720 00000100:00100000:1.0:1787847426.046169:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595422720 00000100:00100000:1.0:1787847426.046250:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 208 00000100:00100000:1.0:1787847426.046263:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+55:11575:x1874693595422720:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:1.0:1787847426.046759:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.046808:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.046823:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847426.046894:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787847426.046970:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed4f8dd6 reply state 0000000097845526 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.046982:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787847426.047730:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11575:x1874693595422720:12345-192.168.201.21@tcp:36:bash.0 Request processed in 1462us (1803us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787847426.047741:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 208 00000020:00080000:1.0:1787847426.047748:0:7214:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787847426.051104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:3.0:1787847426.051384:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.051400:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.051408:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.051415:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.051421:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.051431:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.051463:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.051467:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847426.051492:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.051500:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5200/0x1835de88b98629cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.052208:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595422848 00000100:00100000:1.0:1787847426.052222:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595422848 00000100:00100000:1.0:1787847426.052318:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:1.0:1787847426.052341:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11575:x1874693595422848:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:1.0:1787847426.052376:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.052401:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98629d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f56 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.052546:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.052563:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.052584:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.052627:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.052643:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 58 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.052661:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c6b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616383360:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847426.052779:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deae1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787847426.055589:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c6b8de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1874693616383360:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847426.055632:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847426.057497:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.057887:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595422976 00000100:00100000:1.0:1787847426.057899:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595422976 00010000:00010000:1.0:1787847426.058004:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 59 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.058056:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:1.0:1787847426.058068:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:2347:x1874693595422976:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847426.058088:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847426.058096:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 59 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.058133:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 59 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.058165:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f4f expref: 59 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.058184:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847426.058190:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.058201:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.058211:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.058242:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847426.058307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:2347:x1874693595422976:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 241us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.058315:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00010000:00010000:2.0:1787847426.058839:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.058864:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847426.058966:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787847426.058973:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847426.059004:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.059056:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4200/0x1835de88b98629d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.059082:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.059090:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847426.059093:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847426.059096:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5000, rc 0) 00000100:00100000:2.0:1787847426.059138:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11575:x1874693595422848:12345-192.168.201.21@tcp:101:bash.0 Request processed in 6801us (8048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847426.059146:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 209 00000100:00100000:2.0:1787847426.062867:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.063206:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595423232 00000100:00100000:1.0:1787847426.063220:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595423232 00000100:00100000:1.0:1787847426.063320:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:1.0:1787847426.063333:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+57:11575:x1874693595423232:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:1.0:1787847426.063691:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11575:x1874693595423232:12345-192.168.201.21@tcp:35:bash.0 Request processed in 359us (837us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787847426.063701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1787847426.121403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.121611:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595423360 00000100:00100000:3.0:1787847426.121625:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595423360 00000100:00100000:3.0:1787847426.121701:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:3.0:1787847426.121713:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+58:11581:x1874693595423360:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847426.121745:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847426.121773:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98629e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f5d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.121872:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98629e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.121889:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98629e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.121903:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98629e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847426.122203:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787847426.122209:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847426.122238:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98629e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.122270:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98629e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f5d expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.122294:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98629e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f5d expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.122335:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847426.122339:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847426.122344:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6400, rc 0) 00000100:00100000:3.0:1787847426.122426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:11581:x1874693595423360:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 715us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.122434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 210 00000100:00100000:0.0:1787847426.126454:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.126541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595423488 00000100:00100000:3.0:1787847426.126554:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595423488 00000100:00100000:3.0:1787847426.126627:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:3.0:1787847426.126640:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:11581:x1874693595423488:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847426.126669:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847426.126696:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98629f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f64 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.126806:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.126824:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.126838:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.126868:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.126875:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.126905:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127088:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127098:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127106:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847426.127149:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787847426.127154:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847426.127177:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127191:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127200:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127208:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127215:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127222:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.127226:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127241:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127257:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847426.127261:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847426.127267:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127275:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7600/0x1835de88b98629f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127293:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127299:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127305:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127310:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.127313:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127319:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127327:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c3361100) 00010000:00010000:3.0:1787847426.127330:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847426.127332:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127348:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b98629fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127388:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7200/0x1835de88b98629f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127403:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.127411:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.127413:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847426.127416:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:3.0:1787847426.127501:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11581:x1874693595423488:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 863us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.127509:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 211 00000100:00100000:1.0:1787847426.135260:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616383488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847426.135368:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847426.135668:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616383488 00000100:00100000:2.0:1787847426.135679:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616383488 00000100:00100000:2.0:1787847426.135763:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787847426.135774:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616383488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847426.135803:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787847426.135888:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1874693616383488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847426.135896:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787847426.136084:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616383488:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787847426.136245:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847426.137894:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847426.139156:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847426.139655:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595423872 00000100:00100000:2.0:1787847426.139668:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595423872 00000100:00100000:2.0:1787847426.139740:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:2.0:1787847426.139751:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11581:x1874693595423872:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847426.139781:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847426.139809:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f6b expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.139992:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.140011:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.140158:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.140168:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.140216:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.140234:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847426.140274:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d29a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616383616:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847426.140474:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.140484:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847426.140493:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616383744:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847426.140522:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1254540 going to sleep for 11 seconds 00010000:00010000:3.0:1787847426.144847:0:7214:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.21@tcp) returned -22 from blocking AST (req@000000008b7abd97 x1874693616383616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.144891:0:7214:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.144959:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f64 expref: 61 pid: 5843 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847426.144982:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d29a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616383616:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847426.145222:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616383744:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847426.145254:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.145261:0:7214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.145271:0:7214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.145281:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.145649:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595423616 00000100:00100000:1.0:1787847426.145659:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595423616 00000100:00100000:1.0:1787847426.145743:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1787847426.145755:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:2347:x1874693595423616:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847426.145777:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847426.145780:0:5828:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 1835de88b9862a05) 00010000:00010000:1.0:1787847426.145783:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847426.146745:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.147059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:2347:x1874693595423616:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 1305us (9172us total) trans 0 rc 116/116 00000100:00100000:1.0:1787847426.147074:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:1.0:1787847426.147110:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595424000 00000100:00100000:1.0:1787847426.147116:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595424000 00010000:00010000:1.0:1787847426.147144:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.147183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:1.0:1787847426.147191:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:2346:x1874693595424000:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847426.147203:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847426.147211:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147224:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147250:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b98629db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f56 expref: 61 pid: 5845 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147283:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847426.147289:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147300:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147309:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147349:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847426.147377:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:2346:x1874693595424000:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 186us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.147385:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00010000:00010000:1.0:1787847426.147409:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147418:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847426.147441:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787847426.147646:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ac00/0x1835de88b9862a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 61 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147665:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 60 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.147673:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847426.147683:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787847426.147686:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:1.0:1787847426.147715:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11581:x1874693595423872:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 7966us (8569us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787847426.147722:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 212 00000100:00100000:2.0:1787847426.152639:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.152736:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595424256 00000100:00100000:3.0:1787847426.152750:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595424256 00000100:00100000:3.0:1787847426.152863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1787847426.152876:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11581:x1874693595424256:12345-192.168.201.21@tcp:103:lfs.0 00010000:00010000:3.0:1787847426.152901:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847426.152979:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f41 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.153005:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.153011:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847426.153149:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:11581:x1874693595424256:12345-192.168.201.21@tcp:103:lfs.0 Request processed in 275us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.153157:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1787847426.155870:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.156024:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595424384 00000100:00100000:3.0:1787847426.156038:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595424384 00000100:00100000:3.0:1787847426.156110:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:3.0:1787847426.156123:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e1362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:11581:x1874693595424384:12345-192.168.201.21@tcp:58:lfs.0 00010000:00010000:3.0:1787847426.156299:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.156321:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.156727:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787847426.157145:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787847426.157313:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e1362580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:11581:x1874693595424384:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 1189us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.157323:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 213 00000100:00100000:0.0:1787847426.160192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.160687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595424512 00000100:00100000:3.0:1787847426.160700:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595424512 00000100:00100000:3.0:1787847426.160818:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 214 00000100:00100000:3.0:1787847426.160831:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+59:11581:x1874693595424512:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847426.160860:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847426.160887:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.160995:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.161009:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.161044:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.161083:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.161102:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.161106:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847426.161110:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.161119:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165dc00, rc 0) 00000100:00100000:3.0:1787847426.161201:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e13630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11581:x1874693595424512:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 373us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.161210:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 214 00010000:00010000:0.0:1787847426.520635:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787847426.775640:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787847426.775654:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787847426.775715:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787847426.775723:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787847426.777887:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616383872:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787847426.778089:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1254540 going to sleep for 11 seconds 00000100:00100000:0.0:1787847426.782504:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847426.782527:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616383872:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787847426.782690:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595424640 00000100:00100000:1.0:1787847426.782700:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595424640 00000100:00100000:1.0:1787847426.782789:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:1.0:1787847426.782801:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11582:x1874693595424640:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787847426.782842:0:5845:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787847426.783207:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11582:x1874693595424640:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 405us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.783217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 215 00000100:00100000:3.0:1787847426.798811:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.804707:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595424768 00000100:00100000:1.0:1787847426.804727:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595424768 00000100:00100000:1.0:1787847426.804820:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:1.0:1787847426.804832:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11582:x1874693595424768:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.804961:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.804983:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.804998:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805016:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805047:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805054:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805168:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805178:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805186:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847426.805242:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787847426.805247:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787847426.805441:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805457:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805464:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805472:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805478:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847426.805483:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805500:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805516:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:1.0:1787847426.805520:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847426.805525:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805532:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805552:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805559:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805565:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805570:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847426.805573:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805579:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805586:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d87e122ed00) 00010000:00010000:1.0:1787847426.805589:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847426.805592:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805608:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805627:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805633:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805639:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805645:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847426.805649:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805655:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805663:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847426.805665:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847426.805668:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.805674:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.805953:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bd83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11582:x1874693595424768:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 1100us (7134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.805962:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 216 00000100:00100000:0.0:1787847426.828454:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.829246:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595425024 00000100:00100000:3.0:1787847426.829273:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595425024 00000100:00100000:3.0:1787847426.829358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 217 00000100:00100000:3.0:1787847426.829370:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+60:11582:x1874693595425024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847426.829400:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847426.829428:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f79 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829557:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829576:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829610:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847426.829625:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787847426.829753:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829761:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829769:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829776:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.829781:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829790:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829804:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847426.829807:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787847426.829813:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829820:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829871:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a44 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f79 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829895:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:3.0:1787847426.829897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847426.829902:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f79 expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.829923:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:3.0:1787847426.830461:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:11582:x1874693595425024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1090us (2019us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787847426.830472:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 217 00000100:00100000:0.0:1787847426.844369:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.844477:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595425152 00000100:00100000:3.0:1787847426.844489:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595425152 00000100:00100000:3.0:1787847426.844558:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:3.0:1787847426.844570:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:11582:x1874693595425152:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787847426.844617:0:5844:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787847426.844746:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:11582:x1874693595425152:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.844755:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 218 00000100:00100000:0.0:1787847426.851238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.851451:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595425408 00000100:00100000:1.0:1787847426.851465:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595425408 00000100:00100000:1.0:1787847426.851553:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 219 00000100:00100000:1.0:1787847426.851565:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:11582:x1874693595425408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.851594:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.851598:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787847426.851636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6400/0x1835de88b98629e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f5d expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.851664:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:1.0:1787847426.851670:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787847426.851687:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f80 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787847426.852449:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1787847426.852708:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.852726:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.852737:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.852802:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f80 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.852821:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f80 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.852851:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122ed00) 00010000:00010000:1.0:1787847426.852854:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787847426.852857:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4400, rc 0) 00000100:00100000:1.0:1787847426.852994:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:11582:x1874693595425408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 1431us (1770us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787847426.853004:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 219 00000100:00100000:0.0:1787847426.860711:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.860839:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595425664 00000100:00100000:3.0:1787847426.860852:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595425664 00000100:00100000:3.0:1787847426.860966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 220 00000100:00100000:3.0:1787847426.860979:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d3c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:11582:x1874693595425664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787847426.861062:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847426.861243:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f80 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861302:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122ed00) 00010000:00010000:3.0:1787847426.861317:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847426.861347:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861364:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861376:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861392:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861400:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861407:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861503:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861511:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861518:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861524:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.861529:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861547:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861558:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847426.861561:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847426.861566:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861573:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862a6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861585:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861591:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861597:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861602:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.861605:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861611:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861618:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb66e5c72 (ffff8d87c3361100) 00010000:00010000:3.0:1787847426.861621:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847426.861624:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.861638:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862a75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb66e5c72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847426.861789:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d3c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:11582:x1874693595425664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 811us (1091us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787847426.861798:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 220 00000100:00100000:0.0:1787847426.866550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.866659:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595425792 00000100:00100000:1.0:1787847426.866671:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595425792 00000100:00100000:1.0:1787847426.866742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 221 00000100:00100000:1.0:1787847426.866754:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+61:11582:x1874693595425792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.866782:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.866821:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f87 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.866867:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.866884:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.866897:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.867086:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.867110:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.867128:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:1.0:1787847426.867131:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787847426.867135:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5000, rc 0) 00000100:00100000:1.0:1787847426.867208:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:11582:x1874693595425792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 456us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.867216:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 221 00000100:00100000:0.0:1787847426.871539:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.871633:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595426048 00000100:00100000:1.0:1787847426.871647:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595426048 00000100:00100000:1.0:1787847426.871728:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 222 00000100:00100000:1.0:1787847426.871740:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+62:11582:x1874693595426048:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.871866:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.871888:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.871903:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787847426.872305:0:7214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787847426.872319:0:7214:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341696386827ns, next at 342696383128ns, rc = 0 00000004:00010000:1.0:1787847426.872430:0:7214:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075f94ab0 reply state 00000000d3a8d6d0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.872441:0:7214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787847426.872558:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+64:11582:x1874693595426048:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 819us (1031us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787847426.872588:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 222 00000100:00100000:0.0:1787847426.876522:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:3.0:1787847426.876749:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.876765:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.876774:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.876782:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5c00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847426.876788:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.876808:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.876830:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:3.0:1787847426.876834:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787847426.876839:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.876847:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.877040:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595426176 00000100:00100000:1.0:1787847426.877052:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595426176 00000100:00100000:1.0:1787847426.877196:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:1.0:1787847426.877207:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+63:11582:x1874693595426176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.877240:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.877348:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f8e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.877428:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.877444:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 64 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.877466:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:1.0:1787847426.877469:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787847426.877471:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5a00, rc 0) 00000100:00100000:1.0:1787847426.877550:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+64:11582:x1874693595426176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 345us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.877559:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 223 00000100:00100000:0.0:1787847426.881970:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.882105:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595426304 00000100:00100000:1.0:1787847426.882118:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595426304 00000100:00100000:1.0:1787847426.882205:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:1.0:1787847426.882219:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2347:x1874693595426304:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787847426.882632:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595426304:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 414us (697us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787847426.882654:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:0.0:1787847426.886678:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847426.889548:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595426560 00000100:00100000:2.0:1787847426.889568:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595426560 00000100:00100000:2.0:1787847426.889662:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:2.0:1787847426.889675:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+64:11582:x1874693595426560:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787847426.890415:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+65:11582:x1874693595426560:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 737us (3745us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787847426.890448:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:0.0:1787847426.899196:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.899360:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595426816 00000100:00100000:1.0:1787847426.899373:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595426816 00000100:00100000:1.0:1787847426.899449:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 224 00000100:00100000:1.0:1787847426.899461:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+65:11582:x1874693595426816:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787847426.899615:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+65:11582:x1874693595426816:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 156us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.899625:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 224 00000100:00100000:0.0:1787847426.903152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.903790:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595426944 00000100:00100000:1.0:1787847426.903817:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595426944 00000100:00100000:1.0:1787847426.903921:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:1.0:1787847426.903994:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+65:11582:x1874693595426944:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.904040:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.904081:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f95 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.904175:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.904193:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.904207:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787847426.904255:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787847426.904289:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.904337:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5c00/0x1835de88b9862a98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f95 expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.904360:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f95 expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.904370:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:1.0:1787847426.904373:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787847426.904378:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4400, rc 0) 00000100:00100000:1.0:1787847426.904464:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+66:11582:x1874693595426944:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 532us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.904472:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 225 00000100:00100000:1.0:1787847426.909462:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.910182:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427072 00000100:00100000:3.0:1787847426.910196:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427072 00000100:00100000:1.0:1787847426.910347:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:1.0:1787847426.910362:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+10:2347:x1874693595427072:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.910387:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.910415:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0f9c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847426.910453:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a906303, blocks: 0x1 00010000:00010000:1.0:1787847426.910481:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1787847426.910487:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847426.910499:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.910549:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 11 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.910567:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5c00, rc 0) 00000100:00100000:1.0:1787847426.910650:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:2347:x1874693595427072:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 292us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847426.910659:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:0.0:1787847426.914473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.914576:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427328 00000100:00100000:3.0:1787847426.914590:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427328 00000100:00100000:3.0:1787847426.914674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 226 00000100:00100000:3.0:1787847426.914686:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+66:11582:x1874693595427328:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787847426.914823:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+66:11582:x1874693595427328:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 138us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.914831:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 226 00000100:00100000:0.0:1787847426.925070:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.925193:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427456 00000100:00100000:1.0:1787847426.925206:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427456 00000100:00100000:1.0:1787847426.925288:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:1.0:1787847426.925301:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:11582:x1874693595427456:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847426.925325:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847426.925350:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fa3 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.925390:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.925401:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847426.925406:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847426.925412:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.925458:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 12 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847426.925495:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 12 pid: 6678 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847426.925513:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616384000:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847426.925635:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deae1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787847426.936801:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847426.944343:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427584 00000100:00100000:3.0:1787847426.944365:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427584 00010000:00010000:3.0:1787847426.944438:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 13 pid: 6678 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847426.944503:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1787847426.944515:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2346:x1874693595427584:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847426.944534:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847426.944564:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 13 pid: 6678 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.944581:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 13 pid: 6678 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.944615:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847426.944620:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847426.944648:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 13 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.944661:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 13 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847426.944712:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 13 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847426.944729:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87c7bdbc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1874693616384128:192.168.201.21@tcp:105: 00000100:00100000:3.0:1787847426.944848:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efa95180 going to sleep for 11 seconds 00010000:00010000:2.0:1787847426.945524:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e259de29/0x1835de88b9862aa6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f9c expref: 13 pid: 6678 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847426.945547:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616384000:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847426.945577:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847426.945589:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f4200, rc 0) 00000100:00100000:2.0:1787847426.945634:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:11582:x1874693595427456:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 20335us (20580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847426.945645:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:3.0:1787847426.948000:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87c7bdbc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1874693616384128:192.168.201.21@tcp:105: 00010000:00010000:3.0:1787847426.948034:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847426.948106:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:2346:x1874693595427584:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3592us (11318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847426.948121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:0.0:1787847426.965535:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847426.965649:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427712 00000100:00100000:2.0:1787847426.965662:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427712 00002000:00100000:2.0:1787847426.965732:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d87f9c76580 x1874693595427712/t0(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:642/0 lens 504/0 e 0 to 0 dl 1787847437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847426.965745:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87f9c76580 with x1874693595427712 ext(0->12) 00002000:00010000:2.0:1787847426.965751:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87f9c76580 00000100:00100000:2.0:1787847426.965794:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1787847426.965806:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+11:2346:x1874693595427712:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787847426.966450:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2346:x1874693595427712:12345-192.168.201.21@tcp:4:lhsmtool_posix.0 Request processed in 642us (926us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787847426.966459:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00002000:00100000:2.0:1787847426.966473:0:6682:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d87f9c76580 x1874693595427712/t4294967320(0) o4->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:642/0 lens 504/448 e 0 to 0 dl 1787847437 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787847426.966482:0:6682:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d87f9c76580 with x1874693595427712 ext(0->12) 00002000:00010000:2.0:1787847426.966487:0:6682:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d87f9c76580 00000100:00100000:0.0:1787847426.979628:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847426.979741:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427840 00000100:00100000:1.0:1787847426.979755:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427840 00000100:00100000:1.0:1787847426.979831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:1.0:1787847426.979844:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+66:11582:x1874693595427840:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787847427.073669:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967494 is committed 00000004:00080000:0.0:1787847427.073682:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787847427.073721:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d87deaed3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787847427.073726:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efbc3200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d87deaed300 00000020:00080000:0.0:1787847427.073729:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efbc3300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87f9ddb000 00000020:00080000:0.0:1787847427.073748:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787847427.073798:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:3.0:1787847427.074132:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787847427.074327:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616384256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787847427.074389:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847427.074599:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616384256 00000100:00100000:2.0:1787847427.074606:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616384256 00000100:00100000:2.0:1787847427.074657:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787847427.074665:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616384256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787847427.074687:0:6678:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787847427.074715:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a906302, atime: 0x6a906302, ctime: 0x6a906302, blocks: 0x1 00010000:00010000:2.0:1787847427.074722:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.074739:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=341s v=(0 0) 00010000:00010000:2.0:1787847427.074743:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847427.074750:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.074766:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.074775:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.074783:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.074950:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787847427.075532:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7bdbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616384256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 866us (1141us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787847427.075541:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1787847427.075667:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87e6d2a580/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787847427.075673:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616384256:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787847427.075695:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847427.075701:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.075721:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ae00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847427.075726:0:7621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.075735:0:7621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.075751:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.075758:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac34d7b1/0x1835de88b9862ab4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.075775:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847427.075777:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847427.075779:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787847427.075965:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787847427.076173:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:0.0:1787847427.076180:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:3.0:1787847427.076590:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616384384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787847427.076627:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847427.076668:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847427.076673:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616384512:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787847427.076691:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847427.076718:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616384384 00000100:00100000:3.0:1787847427.076722:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616384384 00000100:00100000:3.0:1787847427.076750:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616384512 00000100:00100000:3.0:1787847427.076752:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616384512 00000100:00100000:3.0:1787847427.076765:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787847427.076781:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88008543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616384384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787847427.076809:0:6677:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787847427.076835:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.076852:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 12 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.076861:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787847427.076865:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787847427.076870:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.076892:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 12 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.076916:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 12 pid: 7920 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.076927:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616384640:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847427.076995:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efa95c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847427.077009:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787847427.077015:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800854f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616384512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787847427.077122:0:7920:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787847427.077125:0:7920:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787847427 00002000:00010000:3.0:1787847427.077127:0:7920:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787847427.077136:0:7920:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787847427 -> 1787847427 00002000:00010000:3.0:1787847427.077139:0:7920:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787847427.077170:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800854f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1874693616384512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (478us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787847427.077176:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:3.0:1787847427.077205:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87e6d29a40/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787847427.077209:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616384512:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1787847427.077591:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1787847427.077609:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d880084dd80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787847427.077613:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d86c2d29f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d880084d240 00000020:00080000:0.0:1787847427.077617:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d86c2d29b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87f9ddb400 00000020:00080000:3.0:1787847427.078257:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787847427.078373:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:0.0:1787847427.080292:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:3.0:1787847427.080714:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9c74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11582:x1874693595427840:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 100868us (101097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847427.080725:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 227 00000100:00100000:3.0:1787847427.083043:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6677:1874693616384640:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847427.083070:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847427.086982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.087457:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595427968 00000100:00100000:1.0:1787847427.087467:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595427968 00010000:00010000:1.0:1787847427.087527:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 13 pid: 7920 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.087563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:1.0:1787847427.087572:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+13:2346:x1874693595427968:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847427.087586:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847427.087592:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 13 pid: 7920 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.087606:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 13 pid: 7920 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.087651:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862876 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f02 expref: 13 pid: 7920 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.087668:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847427.087672:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847427.087678:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.087688:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.087721:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847427.087770:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:2346:x1874693595427968:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 199us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.087778:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00010000:00010000:2.0:1787847427.088077:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.088088:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.088097:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.088105:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.088120:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787847427.088614:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88008543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3302:x1874693616384384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11833us (11984us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787847427.088622:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787847427.088768:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787847427.090128:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87e6d292c0/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787847427.090139:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616384384:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787847427.090206:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847427.090215:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.090226:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847427.090243:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.090254:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.090274:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.090281:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1c0d245/0x1835de88b9862abb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.090301:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847427.090303:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847427.090305:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847427.090722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847427.091068:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595428096 00000100:00100000:3.0:1787847427.091077:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595428096 00000100:00100000:3.0:1787847427.091157:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:3.0:1787847427.091167:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+12:2347:x1874693595428096:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787847427.123101:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1787847427.123115:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1787847427.123123:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:0.0:1787847427.123130:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787847427.123146:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:3.0:1787847427.123328:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595428096:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 32157us (32603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847427.123341:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:1.0:1787847427.130360:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847427.130453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595428352 00000100:00100000:3.0:1787847427.130463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595428352 00000100:00100000:3.0:1787847427.130540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 228 00000100:00100000:3.0:1787847427.130565:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11582:x1874693595428352:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787847427.130622:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847427.130649:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f95 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.130670:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:3.0:1787847427.130675:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847427.130703:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.130717:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.130726:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847427.131393:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e505ec82 reply state 00000000ee24083a transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.131405:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847427.131508:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:11582:x1874693595428352:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 944us (1155us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787847427.131517:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 228 00000100:00080000:0.0:1787847427.131961:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787847427.138244:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.138263:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.138271:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.138292:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847427.138297:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.138317:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.138337:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:3.0:1787847427.138340:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847427.138345:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.138352:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862ac2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.138759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847427.138845:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595428480 00000100:00100000:2.0:1787847427.138855:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595428480 00000100:00100000:2.0:1787847427.138915:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:2.0:1787847427.138924:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2345:x1874693595428480:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787847427.139184:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787847427.139188:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787847427 -> 1787847426 00002000:00010000:2.0:1787847427.139190:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787847426 00002000:00010000:2.0:1787847427.139192:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787847427 -> 1787847426 00002000:00010000:2.0:1787847427.139194:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787847427.139255:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e003c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2345:x1874693595428480:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 331us (500us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787847427.139263:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 70 00000100:00100000:0.0:1787847427.141756:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847427.141814:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595428736 00000100:00100000:3.0:1787847427.141823:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595428736 00000100:00100000:3.0:1787847427.141885:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:3.0:1787847427.141896:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:11582:x1874693595428736:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787847427.141987:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.142001:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.142008:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.142039:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.142066:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 20 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.142078:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616384768:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847427.142156:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efa95480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847427.145699:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.145760:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595428864 00000100:00100000:1.0:1787847427.145768:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595428864 00010000:00010000:1.0:1787847427.145804:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.145848:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:1.0:1787847427.145870:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:2346:x1874693595428864:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847427.145884:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847427.145911:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.145924:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.145967:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:1.0:1787847427.145972:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.145979:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.145984:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.145997:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847427.146043:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:2346:x1874693595428864:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 177us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.146048:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00010000:00010000:3.0:1787847427.146960:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f87 expref: 20 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.146981:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1874693616384768:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847427.147001:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147009:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147015:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147042:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147050:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147057:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147063:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847427.147078:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147085:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147096:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:3.0:1787847427.147099:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787847427.147103:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.147109:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862ac9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.147213:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11582:x1874693595428736:12345-192.168.201.21@tcp:55:lhsmtool_posix.0 Request processed in 5319us (5462us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787847427.147222:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 229 00000100:00100000:0.0:1787847427.149347:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847427.149421:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595428992 00000100:00100000:2.0:1787847427.149433:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595428992 00000100:00100000:2.0:1787847427.149477:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:2.0:1787847427.149483:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595428992:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787847427.149520:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.149535:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.149542:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847427.149545:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847427.149548:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.149571:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.149580:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 8 pid: 6677 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847427.149592:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874693616384896:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847427.149653:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847427.151795:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6678:1874693616384896:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847427.151822:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847427.153598:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.153796:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595429120 00000100:00100000:1.0:1787847427.153806:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595429120 00010000:00010000:1.0:1787847427.153846:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 9 pid: 6677 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.153891:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:1.0:1787847427.153909:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+9:2347:x1874693595429120:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847427.153924:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847427.153981:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 9 pid: 6677 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.154009:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 9 pid: 6677 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.154032:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0a2f7c8/0x1835de88b9862aad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fa3 expref: 9 pid: 6677 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.154045:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847427.154048:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847427.154053:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.154060:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.154085:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847427.154131:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595429120:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 231us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.154139:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00010000:00010000:2.0:1787847427.154557:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154565:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154586:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154591:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154596:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154600:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847427.154603:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154608:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154616:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.154630:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007bd36a8/0x1835de88b9862ad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847427.154678:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595428992:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 5195us (5337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847427.154683:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 71 00000100:00100000:0.0:1787847427.157598:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.157686:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595429376 00000100:00100000:1.0:1787847427.157694:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595429376 00000100:00100000:1.0:1787847427.157741:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 230 00000100:00100000:1.0:1787847427.157747:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11582:x1874693595429376:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787847427.157822:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.157838:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.157872:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.158137:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.158149:0:7214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.158157:0:7214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.158188:0:7214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.158202:0:7214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 20 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.158215:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9d680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616385024:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847427.158282:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deae16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847427.160458:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9d680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616385024:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847427.160485:0:7214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847427.161809:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.161912:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595429504 00000100:00100000:1.0:1787847427.161920:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595429504 00010000:00010000:1.0:1787847427.161986:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.162047:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:1.0:1787847427.162058:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:2346:x1874693595429504:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847427.162074:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847427.162079:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.162089:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.162112:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f8e expref: 21 pid: 5845 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.162128:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:1.0:1787847427.162134:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.162142:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.162148:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.162166:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847427.162210:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:2346:x1874693595429504:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 156us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.162215:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00010000:00010000:0.0:1787847427.162272:0:7214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847427.162280:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847427.162443:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787847427.162543:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787847427.162572:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787847427.162628:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616385152:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787847427.162662:0:7214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847427.162686:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1377900 going to sleep for 11 seconds 00000100:00100000:1.0:1787847427.162776:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616385152 00000100:00100000:1.0:1787847427.162786:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616385152 00000100:00100000:1.0:1787847427.162816:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787847427.162823:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7214:x1874693616385152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787847427.162885:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7214:x1874693616385152:12345-0@lo:1000:mdt00_003.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.162889:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787847427.163095:0:7214:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1787847427.163102:0:7214:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:0.0:1787847427.163116:0:7214:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87e6d29a40, transno 4294967321 00000004:00080000:0.0:1787847427.163208:0:7214:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87e6d292c0, transno 4294967322 00000100:00100000:0.0:1787847427.163751:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616385152:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787847427.164371:0:7214:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787847427.164510:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616385280:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787847427.164559:0:7214:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847427.164622:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c1254540 going to sleep for 11 seconds 00000100:00100000:1.0:1787847427.164667:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616385280 00000100:00100000:1.0:1787847427.164674:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616385280 00000100:00100000:1.0:1787847427.164752:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787847427.164761:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7214:x1874693616385280:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787847427.164976:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7214:x1874693616385280:12345-0@lo:1000:mdt00_003.0 Request processed in 217us (416us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1787847427.164984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787847427.165056:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7214:1874693616385280:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787847427.165087:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165098:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165104:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165110:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847427.165114:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165121:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165135:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e122e900) 00010000:00010000:2.0:1787847427.165139:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787847427.165143:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165160:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4400/0x1835de88b9862ade lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165189:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165195:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165199:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165202:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847427.165204:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165207:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165213:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847427.165215:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787847427.165220:0:7214:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165228:0:7214:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165236:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.165273:0:7214:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847427.165285:0:7214:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616385408:192.168.201.21@tcp:105: 00000100:00100000:2.0:1787847427.165366:0:7214:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b0540 going to sleep for 11 seconds 00000100:00100000:0.0:1787847427.168184:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.168259:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595429632 00000100:00100000:1.0:1787847427.168268:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595429632 00000100:00100000:1.0:1787847427.168327:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:1.0:1787847427.168337:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11581:x1874693595429632:12345-192.168.201.21@tcp:49:lfs.0 00000100:00100000:1.0:1787847427.168463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+24:11581:x1874693595429632:12345-192.168.201.21@tcp:49:lfs.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.168468:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:2.0:1787847427.169347:0:7214:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7214:1874693616385408:192.168.201.21@tcp:105: 00010000:00010000:2.0:1787847427.169373:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169385:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862a21 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169440:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169455:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169466:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169477:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169484:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169492:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169516:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152aa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847427.169520:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169527:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169538:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847427.169541:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847427.169544:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169550:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152aa00/0x1835de88b9862ae5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169560:0:7214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169566:0:7214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169572:0:7214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169577:0:7214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5000 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847427.169579:0:7214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169585:0:7214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169605:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847427.169608:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787847427.169611:0:7214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.169617:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5000/0x1835de88b9862ad7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847427.170015:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:11582:x1874693595429376:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 12265us (12422us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787847427.170026:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 230 00000020:00080000:2.0:1787847427.170031:0:7214:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787847427.172284:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847427.172294:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847427.172802:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787847427.172810:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787847427.174794:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.174883:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595429888 00000100:00100000:1.0:1787847427.174893:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595429888 00000100:00100000:1.0:1787847427.175137:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1787847427.175149:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+23:11582:x1874693595429888:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787847427.176051:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787847427.176152:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787847427.176196:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.176209:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.176217:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.176223:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.176227:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.176230:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.176249:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787847427.176564:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847427.176578:0:7622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.176583:0:7622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847427.176586:0:7622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.176594:0:7622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.176608:0:7622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d87e11d5500) 00010000:00010000:2.0:1787847427.176611:0:7622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787847427.176616:0:7622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.176622:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f5a00/0x1835de88b9862aec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.176650:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847427.176652:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847427.176654:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847427.177183:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+25:11582:x1874693595429888:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 2030us (2391us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787847427.177194:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000020:00080000:1.0:1787847427.177201:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787847427.180465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847427.180587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595430144 00000100:00100000:3.0:1787847427.180597:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595430144 00000100:00100000:3.0:1787847427.180657:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:3.0:1787847427.180667:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+25:11581:x1874693595430144:12345-192.168.201.21@tcp:58:lfs.0 00000040:00080000:3.0:1787847427.181114:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787847427.181255:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d292c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+25:11581:x1874693595430144:12345-192.168.201.21@tcp:58:lfs.0 Request processed in 587us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847427.181264:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 231 00000100:00100000:0.0:1787847427.223243:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847427.223612:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595430272 00000100:00100000:3.0:1787847427.223622:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595430272 00000100:00100000:3.0:1787847427.223732:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 232 00000100:00100000:3.0:1787847427.223744:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+25:11584:x1874693595430272:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847427.223780:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847427.223801:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0faa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.223890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.223916:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.223927:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.223984:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.223991:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.223997:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.224281:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.224293:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 26 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.224302:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.224333:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 26 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847427.224354:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 26 pid: 7214 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.224368:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616385536:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847427.224606:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efa95480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847427.236502:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847427.236569:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1874693616385536:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847427.236606:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847427.242698:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595430528 00000100:00100000:3.0:1787847427.242714:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595430528 00000100:00100000:3.0:1787847427.242796:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:3.0:1787847427.242808:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:5585:x1874693595430528:12345-192.168.201.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787847427.244213:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:5585:x1874693595430528:12345-192.168.201.21@tcp:35:ldlm_bl.0 Request processed in 1404us (7717us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1787847427.244224:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 63 00000100:00100000:3.0:1787847427.249265:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847427.249384:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595430656 00000100:00100000:1.0:1787847427.249394:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595430656 00010000:00010000:1.0:1787847427.249442:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 28 pid: 7214 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847427.249478:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:1.0:1787847427.249487:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:2346:x1874693595430656:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847427.249500:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847427.249518:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 28 pid: 7214 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.249530:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 28 pid: 7214 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.249552:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862a13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f6b expref: 28 pid: 7214 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.249567:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847427.249572:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.249581:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.249589:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847427.249617:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847427.249668:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+27:2346:x1874693595430656:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 182us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847427.249675:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00010000:00010000:2.0:1787847427.250165:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250174:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847427.250217:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787847427.250221:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847427.250246:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250258:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250268:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250275:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250282:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250288:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847427.250299:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250313:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250323:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:2.0:1787847427.250326:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847427.250330:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250336:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9862afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250348:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250354:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250360:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250365:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847427.250368:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250373:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250379:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d87c3361100) 00010000:00010000:2.0:1787847427.250381:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847427.250388:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9862b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250433:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9862af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0faa expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250447:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0faa expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847427.250454:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:2.0:1787847427.250456:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787847427.250458:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c400, rc 0) 00000100:00100000:2.0:1787847427.250501:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11584:x1874693595430272:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 26759us (27268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847427.250507:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 232 00010000:00010000:0.0:1787847427.544842:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787847428.070156:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787847428.070167:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787847428.070216:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787847428.070222:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787847428.185816:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787847428.185826:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787847428.185866:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787847428.185872:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787847428.186026:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616385664:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787847428.186187:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c61e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847428.192149:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d161c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874693616385664:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787847428.196080:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847428.203173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595430784 00000100:00100000:3.0:1787847428.203189:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595430784 00000100:00100000:3.0:1787847428.203274:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 233 00000100:00100000:3.0:1787847428.203286:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11596:x1874693595430784:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787847428.203326:0:5843:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787847428.203461:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11596:x1874693595430784:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 176us (7390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847428.204122:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 233 00000100:00100000:3.0:1787847428.216877:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847428.217008:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595431040 00000100:00100000:0.0:1787847428.217019:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595431040 00000100:00100000:0.0:1787847428.217087:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 234 00000100:00100000:0.0:1787847428.217098:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+26:11596:x1874693595431040:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847428.217121:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847428.217143:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862b0f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fb1 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.217282:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.217299:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.217312:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847428.217325:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787847428.217456:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b9862b0f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fb1 expref: 29 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.217481:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fb1 expref: 28 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.217490:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847428.217493:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847428.217497:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afea00, rc 0) 00000100:00100000:0.0:1787847428.217558:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11596:x1874693595431040:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 462us (692us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787847428.217566:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 234 00000100:00100000:3.0:1787847428.228457:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847428.228516:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847428.228671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595431424 00000100:00100000:0.0:1787847428.228681:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595431424 00000100:00100000:0.0:1787847428.228755:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 235 00000100:00100000:0.0:1787847428.228765:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11596:x1874693595431424:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787847428.228844:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.228874:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.228895:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847428.228989:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595431168 00000100:00100000:1.0:1787847428.228994:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595431168 00010000:00010000:0.0:1787847428.229124:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.229131:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.229149:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.229155:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00000100:00100000:1.0:1787847428.229160:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00010000:00010000:0.0:1787847428.229162:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847428.229175:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847428.229181:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+30:2346:x1874693595431168:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847428.229191:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847428.229195:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847428.229196:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787847428.229203:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847428.229216:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fb1 expref: 30 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847428.229232:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:1.0:1787847428.229239:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847428.229239:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847428.229298:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:2346:x1874693595431168:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 121us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847428.229306:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1787847428.229372:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11596:x1874693595431424:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 608us (854us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787847428.229382:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 235 00000040:00080000:3.0:1787847428.229596:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787847428.229602:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787847428.232380:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787847428.232399:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787847428.233750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847428.234047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595431680 00000100:00100000:0.0:1787847428.234056:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595431680 00000100:00100000:0.0:1787847428.234122:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 64 00000100:00100000:0.0:1787847428.234132:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+28:11596:x1874693595431680:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787847428.234751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:11596:x1874693595431680:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 616us (1003us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787847428.234764:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 64 00010000:00010000:3.0:1787847428.567303:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847429.040326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847429.040492:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595431936 00000100:00100000:1.0:1787847429.040501:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595431936 00000100:00100000:1.0:1787847429.041453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 155 00000100:00100000:1.0:1787847429.041470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:2346:x1874693595431936:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847429.041564:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:2346:x1874693595431936:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 99us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847429.041573:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 155 00000100:00080000:0.0:1787847429.043827:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847429.063075:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847429.063117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847429.063155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847429.063319:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432064 00000100:00100000:2.0:1787847429.063338:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432064 00000100:00100000:2.0:1787847429.063418:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:2.0:1787847429.063428:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595432064:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847429.063500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595431808 00000100:00100000:0.0:1787847429.063506:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595431808 00000100:00100000:2.0:1787847429.063512:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2347:x1874693595432064:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847429.063521:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:0.0:1787847429.063544:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 295 00000100:00100000:0.0:1787847429.063553:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595431808:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847429.063586:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2347:x1874693595431808:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847429.063592:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 295 00000100:00080000:3.0:1787847429.064000:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847429.067005:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432320 00000100:00100000:1.0:1787847429.067020:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432320 00000100:00100000:1.0:1787847429.067156:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 156 00000100:00100000:1.0:1787847429.067168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595432320:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847429.067251:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2347:x1874693595432320:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 87us (4094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847429.067260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 156 00000100:00080000:3.0:1787847429.067408:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847429.070832:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847429.070961:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432192 00000100:00100000:0.0:1787847429.070971:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432192 00000100:00100000:0.0:1787847429.071056:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:0.0:1787847429.071068:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595432192:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847429.071150:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f370c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595432192:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 85us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847429.071158:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00080000:3.0:1787847429.071282:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847429.207327:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787847429.207355:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616385792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847429.207444:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847429.208040:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616385792 00000100:00100000:0.0:1787847429.208050:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616385792 00000100:00100000:0.0:1787847429.208132:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787847429.208143:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616385792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847429.208183:0:6680:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847429.208247:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616385792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847429.208254:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787847429.208560:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616385792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787847429.209974:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787847429.591096:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847429.808797:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787847429.808822:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:3.0:1787847429.936572:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787847429.936580:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787847429.936623:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787847429.936628:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787847430.165895:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847430.166156:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432576 00000100:00100000:0.0:1787847430.166166:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432576 00000100:00100000:0.0:1787847430.166229:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 236 00000100:00100000:0.0:1787847430.166254:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+29:11617:x1874693595432576:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847430.166276:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847430.166298:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fb8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.166400:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.166414:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.166425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847430.166437:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787847430.166562:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fb8 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.166577:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fb8 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.166585:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847430.166588:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787847430.166591:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afea00, rc 0) 00000100:00100000:0.0:1787847430.166656:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:11617:x1874693595432576:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 405us (768us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787847430.166664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 236 00000100:00100000:1.0:1787847430.176870:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847430.177413:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432704 00000100:00100000:0.0:1787847430.177424:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432704 00000100:00100000:0.0:1787847430.177490:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 237 00000100:00100000:0.0:1787847430.177501:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:11617:x1874693595432704:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1787847430.177566:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177583:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177596:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177622:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177629:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177636:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177642:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affa00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847430.177646:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177653:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177664:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:0.0:1787847430.177667:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847430.177672:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847430.177686:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affa00/0x1835de88b9862b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847430.177758:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+31:11617:x1874693595432704:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 259us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847430.177775:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 237 00000100:00100000:1.0:1787847430.321420:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847430.321514:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432832 00000100:00100000:2.0:1787847430.321523:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432832 00000100:00100000:2.0:1787847430.321592:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:2.0:1787847430.321604:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2346:x1874693595432832:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:2.0:1787847430.321624:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847430.321646:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d119445/0x1835de88b9862b47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fbf expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787847430.321674:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a906302, atime: 0x6a906302, ctime: 0x6a906302, blocks: 0xb 00010000:00010000:2.0:1787847430.321695:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1787847430.321700:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847430.321709:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d119445/0x1835de88b9862b47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fbf expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847430.321729:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d119445/0x1835de88b9862b47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fbf expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847430.321743:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847430.321824:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2346:x1874693595432832:12345-192.168.201.21@tcp:101:cat.0 Request processed in 222us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847430.321832:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 72 00000100:00100000:2.0:1787847430.329296:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847430.329391:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595432960 00000100:00100000:3.0:1787847430.329401:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595432960 00002000:00100000:3.0:1787847430.329453:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d88005252c0 x1874693595432960/t0(0) o3->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:646/0 lens 488/0 e 0 to 0 dl 1787847441 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787847430.329466:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d88005252c0 with x1874693595432960 ext(0->4095) 00002000:00010000:3.0:1787847430.329471:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d88005252c0 00000100:00100000:3.0:1787847430.329504:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847430.329514:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595432960:12345-192.168.201.21@tcp:3:cat.0 00000100:00100000:3.0:1787847430.329745:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+8:2347:x1874693595432960:12345-192.168.201.21@tcp:3:cat.0 Request processed in 232us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787847430.329754:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00002000:00100000:3.0:1787847430.329772:0:6683:0:(ofd_dev.c:2715:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d88005252c0 x1874693595432960/t0(0) o3->69a6f4d8-23e4-4b87-ac2d-34a985e74ea3@192.168.201.21@tcp:646/0 lens 488/4536 e 0 to 0 dl 1787847441 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787847430.329781:0:6683:0:(ofd_dev.c:2571:ofd_prolong_extent_locks()) Prolong locks for req ffff8d88005252c0 with x1874693595432960 ext(0->4095) 00002000:00010000:3.0:1787847430.329785:0:6683:0:(ofd_dev.c:2720:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d88005252c0 00010000:00010000:2.0:1787847430.615324:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847430.743642:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616385920:0@lo:400:kworker.0 00000100:00100000:3.0:1787847430.743729:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847430.743861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616385920 00000100:00100000:1.0:1787847430.743869:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616385920 00000100:00100000:1.0:1787847430.743919:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787847430.743928:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616385920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.744797:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616386304:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.744848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847430.744899:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616386176:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.744925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847430.744958:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847430.744964:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616386048:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.744984:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847430.745016:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386176 00000100:00100000:2.0:1787847430.745020:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386176 00000100:00100000:2.0:1787847430.745059:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386048 00000100:00100000:2.0:1787847430.745062:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386048 00000100:00100000:2.0:1787847430.745086:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787847430.745094:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616386176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.745135:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616386176:12345-0@lo:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847430.745142:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787847430.745156:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787847430.745161:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616386048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.745183:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616386048:12345-0@lo:400:kworker.0 Request processed in 22us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847430.745188:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787847430.745218:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847430.745248:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616386048:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.745259:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616386176:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.745298:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386304 00000100:00100000:2.0:1787847430.745302:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386304 00000100:00100000:2.0:1787847430.745326:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787847430.745333:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616386304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.745367:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616386304:12345-0@lo:400:kworker.0 Request processed in 35us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847430.745387:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787847430.745417:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787847430.745423:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787847430.745440:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d87e6d2a580, transno 4294967310 00000100:00100000:2.0:1787847430.745450:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616386304:0@lo:400:kworker.0 00000100:00100000:1.0:1787847430.747400:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616385920:12345-0@lo:400:kworker.0 Request processed in 3464us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847430.747415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1787847430.747873:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847430.747886:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616386560:0@lo:400:kworker.0 00000100:00100000:0.0:1787847430.747949:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847430.747991:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386560 00000100:00100000:0.0:1787847430.747998:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386560 00000100:00100000:0.0:1787847430.748051:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787847430.748061:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616386560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847430.748126:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1874693616386560:12345-0@lo:400:kworker.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847430.748132:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1787847430.748154:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847430.748185:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616386560:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.748537:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787847430.748559:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616386432:0@lo:400:kworker.0 00000100:00100000:2.0:1787847430.748768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847430.748862:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386432 00000100:00100000:0.0:1787847430.748867:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386432 00000100:00080000:2.0:1787847430.748979:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847430.749031:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787847430.749040:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616386432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847430.749102:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616386432:12345-0@lo:400:kworker.0 Request processed in 53us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847430.749108:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787847430.749167:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616386432:0@lo:400:kworker.0 00000100:00100000:3.0:1787847430.749377:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616385920:0@lo:400:kworker.0 00000100:00100000:1.0:1787847431.256422:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847431.256448:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616386688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847431.256526:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847431.256592:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386688 00000100:00100000:1.0:1787847431.256600:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386688 00000100:00100000:1.0:1787847431.256649:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787847431.256659:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616386688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847431.256697:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847431.256742:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1874693616386688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847431.256750:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787847431.256797:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616386688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787847431.642364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847432.340666:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1787847432.340683:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:1.0:1787847432.359166:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787847432.359194:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d87d0dde900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787847432.359199:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efbc3100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d87c60e1e40 00000020:00080000:1.0:1787847432.359230:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d87efbc3800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d87c503f800 00000020:00080000:1.0:1787847432.359278:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1787847432.359284:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:0.0:1787847432.359332:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787847432.359527:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1787847432.665193:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787847433.367404:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847433.367417:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847433.367464:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787847433.367471:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787847433.687154:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847434.168642:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847434.168757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847434.168810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847434.168839:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847434.168866:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847434.169157:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433344 00000100:00100000:1.0:1787847434.169171:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433344 00000100:00100000:1.0:1787847434.169255:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433472 00000100:00100000:1.0:1787847434.169259:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433472 00000100:00100000:1.0:1787847434.169292:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:1.0:1787847434.169306:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595433344:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847434.169412:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2345:x1874693595433344:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 109us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847434.169421:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:1.0:1787847434.169442:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:1.0:1787847434.169449:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2345:x1874693595433472:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847434.169494:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2345:x1874693595433472:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 44us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847434.169501:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00080000:0.0:1787847434.169957:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847434.169964:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787847434.170919:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433088 00000100:00100000:2.0:1787847434.170962:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433088 00000100:00100000:2.0:1787847434.171162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 297 00000100:00100000:2.0:1787847434.171177:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595433088:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847434.171485:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2345:x1874693595433088:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 300us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847434.171511:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 297 00000100:00100000:2.0:1787847434.171581:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433600 00000100:00100000:2.0:1787847434.171588:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433600 00000100:00100000:2.0:1787847434.171648:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433216 00000100:00100000:2.0:1787847434.171652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433216 00000100:00100000:2.0:1787847434.171700:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 160 00000100:00100000:2.0:1787847434.171713:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595433600:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847434.171755:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+5:2345:x1874693595433600:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 47us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847434.171762:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 160 00000100:00100000:2.0:1787847434.171825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 161 00000100:00100000:2.0:1787847434.171834:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2345:x1874693595433216:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847434.171869:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2345:x1874693595433216:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 38us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847434.171876:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 161 00000100:00080000:0.0:1787847434.175241:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847434.331262:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847434.331295:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616386816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787847434.331397:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847434.331499:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386816 00000100:00100000:0.0:1787847434.331509:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386816 00000100:00100000:0.0:1787847434.331591:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787847434.331601:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616386816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787847434.331650:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847434.331708:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c78780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616386816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847434.331716:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787847434.331744:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847434.331808:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616386816:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787847434.711189:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847435.058677:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847435.058865:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433728 00000100:00100000:2.0:1787847435.058874:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433728 00000100:00100000:2.0:1787847435.059029:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 238 00000100:00100000:2.0:1787847435.059040:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:11270:x1874693595433728:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787847435.059178:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:11270:x1874693595433728:12345-192.168.201.21@tcp:60:lhsmtool_posix.0 Request processed in 139us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847435.059186:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 238 00000100:00100000:1.0:1787847435.070911:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847435.073587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595433984 00000100:00100000:0.0:1787847435.073603:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595433984 00000100:00100000:0.0:1787847435.073721:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:0.0:1787847435.073731:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:11270:x1874693595433984:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787847435.074256:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:11270:x1874693595433984:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 524us (3354us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787847435.074265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 65 00000100:00100000:1.0:1787847435.276437:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847435.276541:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595434112 00000100:00100000:2.0:1787847435.276558:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595434112 00000100:00100000:2.0:1787847435.276647:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 239 00000100:00100000:2.0:1787847435.276680:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:12071:x1874693595434112:12345-192.168.201.21@tcp:101:lsof.0 00010000:00010000:2.0:1787847435.276710:0:7214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847435.276738:0:7214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862b4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fc6 expref: -99 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847435.276840:0:7214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862b55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847435.276868:0:7214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862b55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847435.276884:0:7214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862b55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847435.277295:0:7214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787847435.277301:0:7214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847435.277382:0:7214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862b55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847435.277415:0:7214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152ae00/0x1835de88b9862b4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fc6 expref: 7 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847435.277435:0:7214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862b55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fc6 expref: 6 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847435.277446:0:7214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:2.0:1787847435.277449:0:7214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847435.277453:0:7214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847435.277534:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:12071:x1874693595434112:12345-192.168.201.21@tcp:101:lsof.0 Request processed in 858us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847435.277553:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 239 00010000:00010000:2.0:1787847435.735305:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847435.863500:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616387072:0@lo:400:kworker.0 00000100:00100000:3.0:1787847435.863648:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847435.863733:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616387584:0@lo:400:kworker.0 00000100:00100000:3.0:1787847435.863778:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847435.863825:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847435.863833:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616387200:0@lo:400:kworker.0 00000100:00100000:3.0:1787847435.863859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847435.863900:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387584 00000100:00100000:3.0:1787847435.863909:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387584 00000100:00100000:3.0:1787847435.864141:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787847435.864153:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616387584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847435.864219:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616387584:12345-0@lo:400:kworker.0 Request processed in 68us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847435.864247:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787847435.864295:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787847435.864303:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787847435.864335:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fdc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616387584:0@lo:400:kworker.0 00000100:00100000:2.0:1787847435.864482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387072 00000100:00100000:2.0:1787847435.864487:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387072 00000100:00100000:2.0:1787847435.864527:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387200 00000100:00100000:2.0:1787847435.864530:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387200 00000100:00100000:2.0:1787847435.864555:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787847435.864564:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6f36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616387072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847435.864609:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6f36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616387072:12345-0@lo:400:kworker.0 Request processed in 46us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847435.864615:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787847435.864629:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787847435.864635:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616387200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847435.864664:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616387200:12345-0@lo:400:kworker.0 Request processed in 29us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847435.864670:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787847435.864778:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c28b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616386944:0@lo:400:kworker.0 00000100:00100000:1.0:1787847435.864780:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616387328:0@lo:400:kworker.0 00000100:00100000:0.0:1787847435.864851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847435.864885:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847435.864905:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616387456:0@lo:400:kworker.0 00000100:00100000:1.0:1787847435.865000:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387328 00000100:00100000:1.0:1787847435.865010:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387328 00000100:00100000:0.0:1787847435.865048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847435.865076:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787847435.865090:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616387328:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787847435.865108:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787847435.865116:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847435.865133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387456 00000100:00100000:0.0:1787847435.865139:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387456 00000100:00100000:1.0:1787847435.865168:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6e0da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616387328:12345-0@lo:400:kworker.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847435.865192:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787847435.865200:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787847435.865205:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616387456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847435.865268:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616387328:0@lo:400:kworker.0 00000100:00100000:2.0:1787847435.865302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616386944 00000100:00100000:2.0:1787847435.865309:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616386944 00000100:00080000:1.0:1787847435.865330:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847435.865367:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1787847435.865376:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616386944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847435.868202:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616387456:12345-0@lo:400:kworker.0 Request processed in 2986us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847435.868221:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787847435.868323:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616387456:0@lo:400:kworker.0 00000100:00100000:2.0:1787847435.868566:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3301:x1874693616386944:12345-0@lo:400:kworker.0 Request processed in 3188us (3713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847435.868579:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1787847435.868685:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616386944:0@lo:400:kworker.0 00000100:00100000:3.0:1787847435.871643:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616387200:0@lo:400:kworker.0 00000100:00100000:3.0:1787847435.871671:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c28b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616387072:0@lo:400:kworker.0 00000100:00100000:3.0:1787847436.377331:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847436.377376:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616387712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847436.377485:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847436.377546:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387712 00000100:00100000:1.0:1787847436.377559:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387712 00000100:00100000:1.0:1787847436.377630:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787847436.377647:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616387712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847436.377692:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847436.377797:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616387712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847436.377805:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787847436.378050:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616387712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787847436.759235:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787847437.439728:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787847437.439746:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787847437.439762:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787847437.439777:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787847437.783114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787847437.998379:0:12764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 12:17:17 (1787847437) 00010000:00010000:0.0:1787847438.807152:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847439.280261:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847439.280302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847439.280328:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847439.280351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847439.280375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847439.280403:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595434240 00000100:00100000:0.0:1787847439.280414:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595434240 00000100:00100000:0.0:1787847439.280465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 299 00000100:00100000:0.0:1787847439.280476:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595434240:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847439.280624:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2344:x1874693595434240:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 150us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847439.280633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 299 00000100:00100000:0.0:1787847439.280664:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595434368 00000100:00100000:0.0:1787847439.280667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595434368 00000100:00100000:0.0:1787847439.280708:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595434752 00000100:00100000:0.0:1787847439.280710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595434752 00000100:00100000:0.0:1787847439.280725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:0.0:1787847439.280729:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2345:x1874693595434368:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847439.280758:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:2345:x1874693595434368:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847439.280762:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 165 00000100:00100000:0.0:1787847439.280770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:0.0:1787847439.280774:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+6:2344:x1874693595434752:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847439.280792:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4cd94325-5cad-4012-9431-9a61496a2886+6:2344:x1874693595434752:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 18us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847439.280816:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 166 00000100:00100000:0.0:1787847439.281357:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595434624 00000100:00100000:0.0:1787847439.281363:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595434624 00000100:00100000:0.0:1787847439.281393:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595434496 00000100:00100000:0.0:1787847439.281397:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595434496 00000100:00100000:0.0:1787847439.281419:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:0.0:1787847439.281426:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2345:x1874693595434624:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847439.281466:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2345:x1874693595434624:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 40us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847439.281474:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 102 00000100:00100000:0.0:1787847439.281487:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:0.0:1787847439.281493:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595434496:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847439.281750:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2344:x1874693595434496:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 26us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847439.281757:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00080000:0.0:1787847439.281788:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847439.281792:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847439.281794:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847439.447213:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787847439.447508:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616387840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847439.447590:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847439.448581:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387840 00000100:00100000:1.0:1787847439.448592:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387840 00000100:00100000:1.0:1787847439.448655:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787847439.448667:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616387840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847439.448712:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847439.448775:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616387840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847439.448782:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787847439.448833:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6c7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616387840:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787847439.450162:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787847439.831432:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847440.855842:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847440.984196:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616388352:0@lo:400:kworker.0 00000100:00100000:2.0:1787847440.984285:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847440.984359:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787847440.984366:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616387968:0@lo:400:kworker.0 00000100:00100000:2.0:1787847440.984395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847440.984418:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616388480:0@lo:400:kworker.0 00000100:00100000:2.0:1787847440.984443:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847440.984473:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616387968 00000100:00100000:2.0:1787847440.984481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616387968 00000100:00100000:2.0:1787847440.984528:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787847440.984537:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616387968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847440.984588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616387968:12345-0@lo:400:kworker.0 Request processed in 51us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847440.984595:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787847440.984638:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616387968:0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.984691:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616388096:0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.984721:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847440.984755:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616388608:0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.984777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847440.984794:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847440.984799:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388352 00000100:00100000:0.0:1787847440.984800:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87de82d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616388224:0@lo:400:kworker.0 00000100:00100000:1.0:1787847440.984802:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388352 00000100:00100000:0.0:1787847440.984820:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847440.984832:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388608 00000100:00100000:1.0:1787847440.984835:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388608 00000100:00100000:0.0:1787847440.984858:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388480 00000100:00100000:0.0:1787847440.984861:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388480 00000100:00100000:1.0:1787847440.984872:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787847440.984879:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.984885:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388096 00000100:00100000:0.0:1787847440.984887:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388096 00000100:00100000:0.0:1787847440.984898:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388224 00000100:00100000:0.0:1787847440.984900:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388224 00000100:00100000:0.0:1787847440.984914:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787847440.984921:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616388352:12345-0@lo:400:kworker.0 Request processed in 43us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847440.984921:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616388480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847440.984927:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787847440.984971:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787847440.984977:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616388608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.984990:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616388480:12345-0@lo:400:kworker.0 Request processed in 70us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847440.984996:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787847440.985006:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616388608:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847440.985008:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787847440.985012:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787847440.985014:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616388096:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787847440.985029:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787847440.985034:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847440.985039:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616388096:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847440.985044:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787847440.985055:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787847440.985056:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616388096:0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.985060:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847440.985081:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ade00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616388608:0@lo:400:kworker.0 00000100:00100000:0.0:1787847440.987904:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616388224:12345-0@lo:400:kworker.0 Request processed in 2830us (3069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847440.987921:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787847440.990023:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616388480:0@lo:400:kworker.0 00000100:00100000:1.0:1787847440.990157:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616388352:0@lo:400:kworker.0 00000100:00100000:2.0:1787847440.994673:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87de82d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616388224:0@lo:400:kworker.0 00000100:00100000:0.0:1787847441.108776:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847441.108869:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595435008 00000100:00100000:3.0:1787847441.108880:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595435008 00000100:00100000:3.0:1787847441.108991:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00100000:3.0:1787847441.109003:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+18:12292:x1874693595435008:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:3.0:1787847441.109555:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:12292:x1874693595435008:12345-192.168.201.21@tcp:35:umount.0 Request processed in 552us (798us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787847441.109562:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 66 00000100:00080000:0.0:1787847441.109835:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847441.119060:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847441.119412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595435264 00000100:00100000:3.0:1787847441.119422:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595435264 00000100:00100000:3.0:1787847441.119501:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:3.0:1787847441.119512:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+19:12292:x1874693595435264:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:3.0:1787847441.119917:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:12292:x1874693595435264:12345-192.168.201.21@tcp:35:umount.0 Request processed in 405us (866us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787847441.119926:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 67 00000100:00100000:3.0:1787847441.126438:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847441.126583:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595435520 00000100:00100000:2.0:1787847441.126594:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595435520 00000100:00100000:2.0:1787847441.126722:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:2.0:1787847441.126733:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c8fa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+20:12292:x1874693595435520:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:2.0:1787847441.130044:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c8fa5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:12292:x1874693595435520:12345-192.168.201.21@tcp:35:umount.0 Request processed in 3300us (3604us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787847441.130058:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 68 00000100:00100000:1.0:1787847441.135516:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847441.135612:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595435776 00000100:00100000:0.0:1787847441.135623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595435776 00000100:00100000:0.0:1787847441.135690:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:0.0:1787847441.135698:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+21:12292:x1874693595435776:12345-192.168.201.21@tcp:35:umount.0 00000100:00100000:0.0:1787847441.136206:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:12292:x1874693595435776:12345-192.168.201.21@tcp:35:umount.0 Request processed in 506us (700us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787847441.136214:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 69 00000100:00100000:1.0:1787847441.142598:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847441.142965:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847441.150723:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847441.156428:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595435904 00000100:00100000:3.0:1787847441.156443:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595435904 00000100:00100000:3.0:1787847441.156580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595436160 00000100:00100000:3.0:1787847441.156584:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595436160 00000100:00100000:3.0:1787847441.156622:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847441.156632:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+14:2346:x1874693595435904:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847441.156650:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847441.156678:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7c00/0x1835de88b9861b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b51 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.156696:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847441.156758:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+13:2346:x1874693595435904:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 128us (14171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847441.156766:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:3.0:1787847441.156787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:3.0:1787847441.156794:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+12:2346:x1874693595436160:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847441.156805:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847441.156813:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165c600/0x1835de88b9861b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b19 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.156822:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847441.156855:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:2346:x1874693595436160:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 61us (13889us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847441.156862:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:1.0:1787847441.158999:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847441.159030:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595436544 00000100:00100000:1.0:1787847441.159037:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595436544 00000100:00100000:1.0:1787847441.159103:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 73 00000100:00100000:1.0:1787847441.159112:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2343:x1874693595436544:12345-192.168.201.21@tcp:9:umount.0 00000020:00000080:1.0:1787847441.159153:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9862106 00000020:00010000:1.0:1787847441.159160:0:6679:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d87ef4bf800: total 0 00000100:00080000:1.0:1787847441.159165:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d87ef4ba000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787847441.159345:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787847441.159601:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2343:x1874693595436544:12345-192.168.201.21@tcp:9:umount.0 Request processed in 489us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847441.159609:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 73 00000020:00010000:0.0:1787847441.159771:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d87ef4bf800: total 0 00010000:00010000:0.0:1787847441.159804:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d87ef4bf800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787847441.159873:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d119445/0x1835de88b9862b47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fbf expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847441.159907:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8daaa3/0x1835de88b98624a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0df1 expref: 3 pid: 7920 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847441.159922:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d87ef4bf800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787847441.159953:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847441.159955:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847441.159956:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787847441.159965:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847441.161395:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595436032 00000100:00100000:3.0:1787847441.161405:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595436032 00000100:00100000:3.0:1787847441.161461:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:3.0:1787847441.161471:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87de82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+11:2347:x1874693595436032:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847441.161485:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847441.161501:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6aff800/0x1835de88b9861dc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c1c expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.161515:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847441.161563:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87de82f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2347:x1874693595436032:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 94us (10850us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847441.161570:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:0.0:1787847441.175179:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847441.175283:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595436672 00000100:00100000:1.0:1787847441.175292:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595436672 00000100:00100000:1.0:1787847441.175357:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:1.0:1787847441.175367:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+5:2343:x1874693595436672:12345-192.168.201.21@tcp:9:umount.0 00000020:00000080:1.0:1787847441.175410:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861ea5 00000100:00080000:1.0:1787847441.175419:0:6678:0:(import.c:65:import_set_state_nolock()) ffff8d87ef4be800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787847441.175470:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787847441.175770:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+2:2343:x1874693595436672:12345-192.168.201.21@tcp:9:umount.0 Request processed in 404us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847441.175778:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00010000:00010000:2.0:1787847441.176278:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787847441.176317:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847441.203917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847441.204032:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595437696 00000100:00100000:2.0:1787847441.204043:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595437696 00000100:00100000:2.0:1787847441.204129:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 240 00000100:00100000:2.0:1787847441.204140:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+22:2343:x1874693595437696:12345-192.168.201.21@tcp:39:umount.0 00000020:00000080:2.0:1787847441.204175:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861b41 00000020:00010000:2.0:1787847441.204194:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d87e7d85800: total 0 00000100:00080000:2.0:1787847441.204199:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d87c600b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787847441.204239:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1787847441.204443:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d87e7d85800: total 0 00010000:00010000:3.0:1787847441.204486:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d87e7d85800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787847441.204521:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847441.204525:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787847441.204534:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9862494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0dea expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204555:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847441.204558:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847441.204562:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c400/0x1835de88b9862b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0faa expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204575:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847441.204585:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787847441.204590:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afea00/0x1835de88b9862b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fb8 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204605:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847441.204607:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847441.204611:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a600/0x1835de88b986246a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ddc expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204623:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d87c7207000) 00010000:00010000:3.0:1787847441.204626:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847441.204629:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff600/0x1835de88b9861e0b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c2a expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204646:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847441.204649:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847441.204652:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6000/0x1835de88b9862806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0ee6 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204674:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847441.204677:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847441.204681:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4e00/0x1835de88b9862168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0d18 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204692:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d87c3361d00) 00010000:00010000:3.0:1787847441.204694:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787847441.204698:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165ce00/0x1835de88b9862527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e14 expref: 14 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204727:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d87c3361000) 00010000:00010000:3.0:1787847441.204731:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847441.204735:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c14f4a00/0x1835de88b986238a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0da4 expref: 13 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204748:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d87c7207c00) 00010000:00010000:3.0:1787847441.204750:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787847441.204753:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe200/0x1835de88b9861e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c46 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204765:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d87c3361700) 00010000:00010000:3.0:1787847441.204767:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847441.204769:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9862a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0f72 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.204782:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:3.0:1787847441.204784:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847441.204787:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165cc00/0x1835de88b986250b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0e0d expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.205117:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c4d7f600) 00010000:00010000:3.0:1787847441.205119:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847441.205124:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152a800/0x1835de88b9861e27 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c31 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847441.205137:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d87e7d85800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1787847441.205155:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847441.205164:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847441.205167:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847441.205614:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c28b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:69a6f4d8-23e4-4b87-ac2d-34a985e74ea3+7:2343:x1874693595437696:12345-192.168.201.21@tcp:39:umount.0 Request processed in 1474us (1707us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787847441.205625:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 240 00000100:00100000:2.0:1787847441.495503:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847441.495528:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616388736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847441.495598:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847441.497318:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388736 00000100:00100000:1.0:1787847441.497330:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388736 00000100:00100000:1.0:1787847441.497399:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787847441.497408:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616388736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787847441.497444:0:6681:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847441.497515:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616388736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847441.497522:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787847441.497599:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616388736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787847441.879963:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787847442.569869:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:2.0:1787847442.569881:0:7632:0:(genops.c:885:class_export_put()) final put ffff8d87ef4bf800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:3.0:1787847442.570183:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ef4bf800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 for lustre-OST0001 00000020:00000080:3.0:1787847442.570237:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87ef4ba000 for lustre-OST0001 00000001:00080000:0.0:1787847442.571527:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787847442.571539:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000001:00080000:0.0:1787847442.571545:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1787847442.571557:0:5866:0:(genops.c:885:class_export_put()) final put ffff8d87e7d85800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:2.0:1787847442.571626:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e7d85800/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 for lustre-MDT0000 00000020:00000080:2.0:1787847442.571763:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87c600b800 for lustre-MDT0000 00000100:00100000:1.0:1787847442.631407:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847442.631621:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595437952 00000100:00100000:0.0:1787847442.631641:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595437952 00000100:00100000:0.0:1787847442.631709:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:0.0:1787847442.631719:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2346:x1874693595437952:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847442.631743:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847442.631763:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6afe000/0x1835de88b9861c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b90 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847442.631791:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847442.632048:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:2346:x1874693595437952:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 330us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847442.632058:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1787847442.638021:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847442.638067:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847442.639514:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595437824 00000100:00100000:3.0:1787847442.639526:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595437824 00000100:00100000:3.0:1787847442.639580:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595438080 00000100:00100000:3.0:1787847442.639584:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595438080 00000100:00100000:3.0:1787847442.639610:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1787847442.639619:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+10:2347:x1874693595437824:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847442.639644:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847442.639667:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6aff000/0x1835de88b9861c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b66 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847442.639684:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847442.639744:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+9:2347:x1874693595437824:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 125us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847442.639752:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1787847442.639771:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1787847442.639777:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+8:2346:x1874693595438080:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847442.639785:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847442.639794:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152ba00/0x1835de88b9861db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0c15 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847442.639804:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847442.639822:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+7:2346:x1874693595438080:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 46us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847442.639846:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:3.0:1787847442.640403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847442.640495:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595438336 00000100:00100000:3.0:1787847442.640500:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595438336 00000100:00100000:3.0:1787847442.640542:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 241 00000100:00100000:3.0:1787847442.640550:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+6:2343:x1874693595438336:12345-192.168.201.21@tcp:39:umount.0 00000020:00000080:3.0:1787847442.640583:0:7214:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861c28 00000020:00010000:3.0:1787847442.640591:0:7214:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d88007a6000: total 0 00000100:00080000:3.0:1787847442.640596:0:7214:0:(import.c:65:import_set_state_nolock()) ffff8d88007a4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787847442.640619:0:7214:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787847442.641397:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4cd94325-5cad-4012-9431-9a61496a2886+5:2343:x1874693595438336:12345-192.168.201.21@tcp:39:umount.0 Request processed in 845us (993us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787847442.641405:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 241 00000100:00080000:3.0:1787847442.641525:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1787847442.641805:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d88007a6000: total 0 00010000:00010000:2.0:1787847442.641845:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d88007a6000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787847442.641876:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c3361a00) 00010000:00010000:2.0:1787847442.641880:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847442.641888:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87f152b400/0x1835de88b9862b55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fc6 expref: 4 pid: 7214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847442.641921:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d88007a6000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787847442.641961:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847442.641964:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847442.641978:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847442.664352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847442.664512:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595438592 00000100:00100000:0.0:1787847442.664523:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595438592 00000100:00100000:0.0:1787847442.664601:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 301 00000100:00100000:0.0:1787847442.664612:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+7:2343:x1874693595438592:12345-192.168.201.21@tcp:251:umount.0 00000020:00000080:0.0:1787847442.664667:0:5835:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861b1e 00000020:00010000:0.0:1787847442.664676:0:5835:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d87ff954800: total 0 00000100:00080000:0.0:1787847442.664681:0:5835:0:(import.c:65:import_set_state_nolock()) ffff8d87ff952800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787847442.664768:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69bd20f9-b82b-4055-8d65-e297ac8f20aa+3:2343:x1874693595438592:12345-192.168.201.21@tcp:251:umount.0 Request processed in 158us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847442.664776:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 301 00000020:00010000:1.0:1787847442.664878:0:7622:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d87ff954800: total 0 00010000:00010000:1.0:1787847442.664883:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847442.664928:0:7622:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d87ff954800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787847442.664988:0:7622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152be00/0x1835de88b9861b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0b58 expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847442.665002:0:7622:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d87ff954800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787847442.665024:0:7622:0:(genops.c:885:class_export_put()) final put ffff8d87ff954800/69bd20f9-b82b-4055-8d65-e297ac8f20aa 00010000:00010000:1.0:1787847442.665034:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847442.665043:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847442.665044:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787847442.665291:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ff954800/69bd20f9-b82b-4055-8d65-e297ac8f20aa for MGS 00000020:00000080:0.0:1787847442.665326:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87ff952800 for MGS 00010000:00010000:3.0:1787847442.910630:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787847443.607145:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787847443.607155:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847443.607657:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787847443.607665:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787847443.927247:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787847444.522668:0:12960:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787847444.535184:0:12960:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787847444.535233:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.535265:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.535273:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.535279:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.535304:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787847444.535310:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787847444.535330:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787847444.535335:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787847444.535340:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787847444.535365:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d87f913b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787847444.535423:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616388864:0@lo:39:umount.0 00000100:00100000:1.0:1787847444.535490:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787847444.536853:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847444.536863:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.536874:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6a00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847444.536957:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.536967:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847444.536975:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847444.536981:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787847444.536983:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787847444.536987:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787847444.537015:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.537022:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847444.537050:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.537057:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6a00/0x1835de88b9861bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bdb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.537068:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847444.537069:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847444.537071:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847444.537089:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388864 00000100:00100000:2.0:1787847444.537102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388864 00000100:00100000:2.0:1787847444.537150:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787847444.537158:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874693616388864:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787847444.537180:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b986192d 00000100:00080000:2.0:1787847444.537186:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d880091c000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787847444.537303:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616388992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787847444.537380:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847444.537514:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616388992 00000100:00100000:3.0:1787847444.537518:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616388992 00000100:00100000:3.0:1787847444.537553:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787847444.537560:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+19:3300:x1874693616388992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847444.537569:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847444.537581:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031600/0x1835de88b9861bdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861bd4 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.537593:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847444.537631:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3300:x1874693616388992:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847444.537639:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787847444.537708:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9fded00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:3300:1874693616388992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787847444.538573:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1874693616388864:12345-0@lo:39:umount.0 Request processed in 1412us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847444.538582:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1787847444.538591:0:5844:0:(genops.c:885:class_export_put()) final put ffff8d880091a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787847444.538741:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787847444.539325:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87f913b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787847444.539372:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616388864:0@lo:39:umount.0 00000020:00000080:2.0:1787847444.539392:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880091a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787847444.539442:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d880091c000 for lustre-MDT0000 00000100:00080000:0.0:1787847444.539488:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787847444.539492:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787847444.539497:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787847444.540639:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540652:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540658:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540676:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540740:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847444.540749:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540756:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540762:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.540768:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.540837:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847444.540845:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.540852:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847444.540856:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.540865:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847444.540872:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847444.540877:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787847444.540879:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787847444.540909:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.540916:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847444.540976:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847444.540977:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616389120:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847444.540984:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff200/0x1835de88b9861be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861be9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.540996:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847444.540998:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.541023:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c29d1200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847444.541026:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.541032:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847444.541034:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787847444.541039:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847444.541044:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787847444.541046:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1787847444.541057:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.541061:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847444.541074:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847444.541081:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847444.541082:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847444.541084:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847444.541088:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616389120 00000100:00100000:3.0:1787847444.541093:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847444.541093:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616389120 00000100:00100000:3.0:1787847444.541101:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616389248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847444.541126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847444.541131:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787847444.541140:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9fded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3301:x1874693616389120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847444.541148:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616389248 00000100:00100000:3.0:1787847444.541151:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616389248 00010000:00010000:2.0:1787847444.541151:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847444.541165:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7a00/0x1835de88b9861be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861be2 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847444.541173:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787847444.541175:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847444.541178:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3303:x1874693616389248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847444.541190:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847444.541199:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b200/0x1835de88b9861adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861ad8 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847444.541205:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9fded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+18:3301:x1874693616389120:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (171us total) trans 0 rc 0/0 00010000:00010000:3.0:1787847444.541210:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847444.541211:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787847444.541231:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3303:x1874693616389248:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847444.541237:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847444.541245:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616389120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847444.541258:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616389248:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847444.541549:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787847444.541554:0:12960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c29d1200/0x1835de88b9861ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861adf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847444.541569:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787847444.541575:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.541580:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.541586:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.541609:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847444.541639:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847444.541645:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847444.541651:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847444.541654:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847444.541660:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847444.541672:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847444.541678:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787847444.541681:0:7621:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787847444.541696:0:7621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847444.541702:0:7621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847444.541726:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847444.541735:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847444.541737:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847444.541738:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847444.541776:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847444.541787:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616389376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787847444.541814:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847444.541903:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616389376 00000100:00100000:1.0:1787847444.541908:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616389376 00000100:00100000:1.0:1787847444.541980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787847444.541987:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6c78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+16:3302:x1874693616389376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787847444.541995:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847444.542344:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9861de1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861dda expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847444.542355:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847444.542478:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800514780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616389376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847444.542520:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6c78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:3302:x1874693616389376:12345-0@lo:103:ldlm_bl.0 Request processed in 533us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847444.542528:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787847444.542632:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787847444.542638:0:12960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9861dda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861de1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847444.542649:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787847444.542656:0:12960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.542663:0:12960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.542670:0:12960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847444.542676:0:12960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.542708:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847444.542713:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.542719:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0031200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847444.542722:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.542729:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847444.542734:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847444.542740:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787847444.542742:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:2.0:1787847444.542758:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.542764:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787847444.542790:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.542798:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847444.542800:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847444.542810:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847444.542846:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847444.542857:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616389504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847444.542893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847444.543109:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616389504 00000100:00100000:2.0:1787847444.543114:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616389504 00000100:00100000:2.0:1787847444.543150:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787847444.543158:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+15:3301:x1874693616389504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787847444.543167:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847444.543177:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c29d1800/0x1835de88b9861893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b986188c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847444.543191:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847444.543230:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:3301:x1874693616389504:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847444.543237:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787847444.543314:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f9ce21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616389504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847444.543407:0:12960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787847444.543412:0:12960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c0031200/0x1835de88b986188c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861893 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847444.543424:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:0.0:1787847444.543428:0:12960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787847444.543430:0:12960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787847444.543458:0:12960:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787847444.543462:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787847444.543473:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787847444.543480:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787847444.543484:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d8800753000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787847444.543490:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d87e7d80800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787847444.543497:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d88007a6000 4cd94325-5cad-4012-9431-9a61496a2886 192.168.201.21@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787847444.543501:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d87c6090000) has exports, disconnecting them 00000020:00080000:0.0:1787847444.543507:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d8800753000), last request at 1787847440 00000020:00000080:0.0:1787847444.543513:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861aa0 00000100:00080000:0.0:1787847444.543529:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d8800755000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787847444.543617:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787847444.543723:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d8800753000): rc 0 00000020:00000080:0.0:1787847444.543726:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d8800753000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787847444.543742:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d87e7d80800), last request at 1787847440 00000020:00000080:0.0:1787847444.543746:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98619c7 00000100:00080000:0.0:1787847444.543752:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d87e7d87000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1787847444.543778:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d8800753000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787847444.543819:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d8800755000 for lustre-MDT0000 00010000:00010000:3.0:1787847444.544103:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787847444.544196:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d87e7d80800): rc 0 00000020:00000080:0.0:1787847444.544199:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87e7d80800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787847444.544217:0:12960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4f1c0d1fae0 00000100:00080000:0.0:1787847444.544237:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787847444.544240:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787847444.544254:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787847444.544359:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787847444.544512:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d8800585800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787847444.544532:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787847444.544534:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787847444.544544:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787847444.544610:0:12960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787847444.544621:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d88007a7800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787847444.544649:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d87c6090000) has no exports 00000100:00100000:2.0:1787847444.544841:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616389760:0@lo:9:umount.0 00000100:00100000:2.0:1787847444.544889:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847444.544920:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616389888:0@lo:9:umount.0 00000100:00100000:2.0:1787847444.544967:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847444.545106:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616389760 00000100:00100000:0.0:1787847444.545113:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616389760 00000100:00100000:0.0:1787847444.545195:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616389888 00000100:00100000:0.0:1787847444.545199:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616389888 00000020:00000080:3.0:1787847444.545887:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e7d80800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787847444.545925:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87e7d87000 for lustre-MDT0000 00000100:00100000:3.0:1787847444.545953:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847444.545972:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800855e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:0:1874693616389632:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787847444.546167:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847444.546190:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787847444.546203:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1874693616389760:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787847444.546227:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861a30 00000100:00080000:1.0:1787847444.546235:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8d86c1837800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787847444.546279:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787847444.546540:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ce21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3299:x1874693616389760:12345-0@lo:9:umount.0 Request processed in 341us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847444.546548:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787847444.546605:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d8800585800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787847444.546617:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787847444.546619:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787847444.546622:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616389760:0@lo:9:umount.0 00010000:00010000:3.0:1787847444.546673:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787847444.547230:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847444.547235:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847444.547342:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787847444.547351:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3299:x1874693616389888:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787847444.547368:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861b09 00000100:00080000:0.0:1787847444.547375:0:6679:0:(import.c:65:import_set_state_nolock()) ffff8d87e7601000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787847444.547411:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787847444.547703:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3299:x1874693616389888:12345-0@lo:9:umount.0 Request processed in 353us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847444.547711:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787847444.547743:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d88007a7800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787847444.547753:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787847444.547755:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787847444.547758:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616389888:0@lo:9:umount.0 00010000:00010000:2.0:1787847444.547870:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787847444.556288:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d87c6090000) has no exports 00000020:00000080:1.0:1787847444.598358:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98618e7 00000020:00000080:1.0:1787847444.598375:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87e75bd000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787847444.598434:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787847444.598506:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787847444.598517:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787847444.598521:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d87c51c19d0) has no exports 00000020:00000080:0.0:1787847444.598844:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98618e0 00000020:00000080:0.0:1787847444.598850:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87e75bb000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787847444.599222:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e75bd000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787847444.599483:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e75bb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787847444.599578:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787847444.599588:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787847444.599591:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87e75bd800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787847444.599602:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e75bd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787847444.599610:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787847444.953466:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787847445.141440:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787847445.141450:0:6706:0:(genops.c:885:class_export_put()) final put ffff8d86c1832000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787847445.141484:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:0.0:1787847445.141487:0:6706:0:(genops.c:885:class_export_put()) final put ffff8d87ef4be000/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 00000020:00000080:2.0:1787847445.141572:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c1832000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787847445.141642:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ef4be000/69a6f4d8-23e4-4b87-ac2d-34a985e74ea3 for lustre-OST0000 00000020:00000080:2.0:1787847445.141665:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d86c1837800 for lustre-OST0000 00000020:00000080:2.0:1787847445.141670:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87ef4be800 for lustre-OST0000 00010000:00010000:1.0:1787847445.986169:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847446.103261:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616390272:0@lo:400:kworker.0 00000100:00100000:3.0:1787847446.103349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847446.103499:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616390016:0@lo:400:kworker.0 00000100:00100000:0.0:1787847446.103608:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616390144:0@lo:400:kworker.0 00000100:00100000:1.0:1787847446.103667:0:7214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616390272 00000100:00100000:1.0:1787847446.103674:0:7214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616390272 00000100:00100000:1.0:1787847446.103727:0:7214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787847446.103734:0:7214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1874693616390272:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787847446.103741:0:7214:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787847446.108130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847446.108239:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616390016 00000100:00100000:2.0:1787847446.108248:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616390016 00000100:00100000:3.0:1787847446.108803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1787847446.108816:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:3302:x1874693616390016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847446.108881:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c6f80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:419007c4-9cf4-45fe-a98f-f6eaa183effb+14:3302:x1874693616390016:12345-0@lo:400:kworker.0 Request processed in 69us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847446.108888:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1787847446.109135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847446.111759:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616390016:0@lo:400:kworker.0 00000100:00100000:2.0:1787847446.112636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616390144 00000100:00100000:2.0:1787847446.112645:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616390144 00000100:00100000:2.0:1787847446.112703:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787847446.112712:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874693616390144:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787847446.112722:0:5844:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787847446.112803:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874693616390144:12345-0@lo:400:kworker.0 Request processed in 90us (3667us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787847446.112810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1787847446.114750:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787847446.114758:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d87ef029000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787847446.114763:0:3303:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787847446.116189:0:7214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3300:x1874693616390272:12345-0@lo:400:kworker.0 Request processed in 12447us (12833us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787847446.116204:0:7214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1787847446.116353:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787847446.116359:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d86c18b1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787847446.116372:0:3300:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787847446.116377:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8d86c18b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787847446.116382:0:3300:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1787847446.116390:0:3300:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d86c18b1000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847446.116427:0:3300:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d8800368780 x1874693616390400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847446.116456:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616390272:0@lo:400:kworker.0 00000100:00100000:0.0:1787847446.116596:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616390400:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1787847446.116651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847446.116793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616390400 00000100:00100000:1.0:1787847446.116800:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616390400 00000100:00100000:1.0:1787847446.116836:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787847446.116842:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1874693616390400:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787847446.116858:0:5845:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787847446.137624:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1874693616390400:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 20772us (20964us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787847446.137639:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787847446.139534:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d86c18b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847446.139544:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787847446.139548:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616390400:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1787847446.146822:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d87ef029000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787847446.146837:0:3303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 153 00000100:00080000:3.0:1787847446.146848:0:3303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d87ef029000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847446.146890:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d88007ad2c0 x1874693616390528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787847446.146926:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616390144:0@lo:400:kworker.0 00000100:00100000:0.0:1787847446.147215:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616390528:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787847446.147290:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847446.147577:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616390528 00000100:00100000:2.0:1787847446.147586:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616390528 00000100:00100000:2.0:1787847446.147632:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787847446.147640:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616390528:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1787847446.147657:0:5843:0:(ldlm_lib.c:1213:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787847446.147708:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616390528:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 67us (417us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787847446.147728:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787847446.147848:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87ef029000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847446.147853:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787847446.147856:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ad2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616390528:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787847446.999131:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787847447.677062:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4cd94325-5cad-4012-9431-9a61496a2886 00000001:00080000:0.0:1787847447.677075:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787847447.677081:0:5866:0:(genops.c:885:class_export_put()) final put ffff8d88007a6000/4cd94325-5cad-4012-9431-9a61496a2886 00000020:00000080:0.0:1787847447.677329:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d88007a6000/4cd94325-5cad-4012-9431-9a61496a2886 for lustre-MDT0000 00000020:00000080:0.0:1787847447.677400:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d88007a4000 for lustre-MDT0000 00000001:00100000:2.0:1787847447.678969:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787847447.678976:0:7632:0:(genops.c:885:class_export_put()) final put ffff8d87e7607000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787847447.679035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e7607000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787847447.679147:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87e7601000 for lustre-OST0001 00010000:00010000:2.0:1787847448.023548:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847449.047311:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847450.072037:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787847450.647035:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87c5150cc0 - data ffff8d87d13706c0/ffff8d87f9c27000 00000020:01000000:0.0:1787847450.647170:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87d1926a80 - data ffff8d87d11b0d80/ffff8d87c61aa800 00000001:00000004:0.0:1787847450.652486:0:12960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1787847450.726236:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787847450.726246:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1787847450.726273:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787847450.726290:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787847450.727539:0:6703:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787847450.727545:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1787847450.727566:0:6703:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1787847450.729773:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787847450.729783:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1787847450.729842:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787847450.729846:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787847450.730376:0:7914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787847450.730382:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1787847450.730401:0:7914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787847450.806888:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98618af 00000020:00000080:3.0:1787847450.807132:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87f913e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787847450.808883:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87f913e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787847450.809120:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98618c4 00000020:00000080:3.0:1787847450.809128:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d880091e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787847450.809140:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787847450.809145:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787847450.809146:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880091e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1787847450.809154:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787847450.809158:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d87c6094d70) has no exports 00000004:01000000:3.0:1787847450.809335:0:12960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787847450.809342:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861b02 00000020:00000080:3.0:1787847450.809345:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d8800363800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787847450.809361:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787847450.809365:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787847450.809371:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787847450.809373:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d8800864d70) has no exports 00000020:00000080:0.0:1787847450.809378:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d8800363800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787847450.809379:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861afb 00000020:00000080:3.0:1787847450.809383:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d88007a4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787847450.809394:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d88007a4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787847450.809677:0:12960:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787847450.809682:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787847450.809686:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787847450.809691:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787847450.809694:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787847450.809730:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787847450.809730:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d88007a7800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787847450.809737:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787847450.809751:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d88007a6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787847450.809754:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d88007a6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787847450.809758:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787847450.809809:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861a0d 00000020:00000080:3.0:1787847450.809812:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d86c1830800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787847450.809821:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787847450.809824:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787847450.809827:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787847450.809830:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d86c24cb3a0) has no exports 00000020:00000080:3.0:1787847450.809833:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861a06 00000020:00000080:3.0:1787847450.809836:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d8800587000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787847450.809837:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c1830800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787847450.809842:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d8800587000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787847450.811309:0:12960:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787847450.811315:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787847450.811319:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787847450.811325:0:12960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787847450.811327:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787847450.811375:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847450.811383:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787847450.811411:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847450.811414:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787847450.811418:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87f913a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787847450.811422:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87f913a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787847450.811433:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787847450.811582:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98618cb 00000020:00000080:2.0:1787847450.811588:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d880091e800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787847450.811594:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787847450.811597:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847450.811601:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787847450.811604:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d8800860000) has no exports 00000020:00000080:2.0:1787847450.811623:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847450.811626:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787847450.811629:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98618d2 00000020:00000080:2.0:1787847450.811632:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d880091a800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787847450.811639:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87d0568000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787847450.811642:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87d0568000 3 00000020:01000004:2.0:1787847450.811645:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d87d0568000 from lustre-MDT0000 00000020:00000080:2.0:1787847450.811659:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847450.811672:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787847450.811674:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87f913e800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787847450.811676:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87f913e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787847450.811683:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787847450.811708:0:12960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787847450.811711:0:12960:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787847450.811714:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787847450.811716:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847450.811718:0:12960:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787847450.811724:0:12960:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d87c9354800 419007c4-9cf4-45fe-a98f-f6eaa183effb 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787847450.811729:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d87c60933a0) has exports, disconnecting them 00000020:00080000:2.0:1787847450.811733:0:12960:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d87c9354800), last request at 1787847219 00000020:00000080:2.0:1787847450.811758:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861870 00000020:00010000:2.0:1787847450.811761:0:12960:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d87c9354800: total 2 00000100:00080000:2.0:1787847450.811765:0:12960:0:(import.c:65:import_set_state_nolock()) ffff8d87c8f91800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787847450.811779:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d87c9354800): rc 0 00000020:00080000:2.0:1787847450.811782:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d87c60933a0) has no exports 00000100:00100000:2.0:1787847450.811830:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d87c6197800:5838] 2 exiting: rc = 0 00000100:00100000:2.0:1787847450.811917:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d87c6e30800:5837] 1 exiting: rc = 0 00000100:00100000:3.0:1787847450.812178:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d87c8712c00:5835] 0 exiting: rc = 1 00000020:00000080:3.0:1787847450.812284:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d8800585800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787847450.812290:0:38:0:(genops.c:885:class_export_put()) final put ffff8d86c1835800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787847450.812292:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c1835800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787847450.812299:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787847450.812384:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880091e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787847450.812395:0:38:0:(genops.c:885:class_export_put()) final put ffff8d880091c800/lustre-MDD0000_UUID 00000020:00000080:3.0:1787847450.812397:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880091c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787847450.812402:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:2.0:1787847450.812636:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812645:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812652:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812657:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812662:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812668:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812674:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812679:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812685:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812806:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812812:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812818:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812824:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812839:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812846:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812852:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812858:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812864:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812869:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812875:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812882:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.812887:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1787847450.812963:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d87c9354800: total 2 00010000:00010000:0.0:1787847450.812995:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d87c9354800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787847450.813025:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031c00/0x1835de88b9861bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861baa expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813044:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b000/0x1835de88b9861dbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861db7 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813054:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165d800/0x1835de88b9861bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861bb8 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813064:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a000/0x1835de88b9861b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861b80 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813073:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152a200/0x1835de88b9861c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861bfe expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813081:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9861b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861b8e expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813103:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c0031400/0x1835de88b986197a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861973 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813114:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9861dd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1835de88b9861dcc expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847450.813123:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d87c9354800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787847450.813136:0:5832:0:(genops.c:885:class_export_put()) final put ffff8d87c9354800/419007c4-9cf4-45fe-a98f-f6eaa183effb 00010000:00010000:0.0:1787847450.813149:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847450.813151:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847450.813153:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847450.813289:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813296:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813301:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813306:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813312:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813317:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813321:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813326:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813331:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813335:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813340:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813344:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813348:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813353:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813358:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813364:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813369:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813373:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813378:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813383:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813388:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813393:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813398:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813403:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813408:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813412:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813424:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813429:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813434:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813439:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813443:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813447:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813452:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813457:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813461:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813467:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813472:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813477:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813481:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813496:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813501:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.813505:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787847450.813967:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880091a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787847450.813973:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c9354800/419007c4-9cf4-45fe-a98f-f6eaa183effb for MGS 00000020:00000080:3.0:1787847450.814049:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87c8f91800 for MGS 20000000:01000000:2.0:1787847450.815344:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787847450.815349:0:12960:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1787847450.816378:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87c6ec4300 - data ffff8d87ffdbaca8/ffff8d87c3867000 00000020:01000000:3.0:1787847450.816507:0:12960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87d179f600 - data ffff8d87f1063438/ffff8d87c2e11c00 00000020:00000080:3.0:1787847450.818338:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861854 00000020:00000080:3.0:1787847450.818346:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87c9356800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787847450.818362:0:12960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87d0568000 from MGS, refs=2 00000020:01000004:3.0:1787847450.818365:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87d0568000 2 00000020:01000004:3.0:1787847450.818367:0:12960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d87d0568000 from MGS 00000020:00000080:3.0:1787847450.818383:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787847450.818390:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787847450.818392:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87c9350000/MGS 00000020:00000080:3.0:1787847450.818395:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c9350000/MGS for MGS 00000020:01000000:3.0:1787847450.818400:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787847450.818449:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787847450.818452:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787847450.818456:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787847450.818462:0:12960:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d880091b000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787847450.818466:0:12960:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d87c51c4d70) has exports, disconnecting them 00000020:00080000:3.0:1787847450.818469:0:12960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d880091b000), last request at 1787847220 00000020:00000080:3.0:1787847450.818472:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b986191f 00000020:00080000:3.0:1787847450.818479:0:12960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d880091b000): rc 0 00000020:00000080:3.0:1787847450.818482:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d880091b000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787847450.819739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c9356800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787847450.819751:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d880091b000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1787847450.839083:0:12960:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787847450.839092:0:12960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787847450.839097:0:12960:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787847450.839105:0:12960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787847450.839317:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847450.839327:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787847450.839342:0:12960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87d0568000 1 00000020:00000080:2.0:1787847450.839349:0:12960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861846 00000020:00000080:2.0:1787847450.839357:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87c9357000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787847450.839363:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787847450.839369:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847450.839374:0:12960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787847450.839378:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d87c7c04d70) has no exports 00000020:00000080:0.0:1787847450.839494:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87f913b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787847450.839501:0:8:0:(genops.c:885:class_export_put()) final put ffff8d87e7602000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787847450.839503:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e7602000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787847450.839513:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787847450.839568:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c9357000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787847450.887289:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847450.887304:0:12960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787847450.887310:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87d0569000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787847450.887326:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87d0569000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787847450.887333:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787847450.887445:0:12960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d87d056a800 00000020:01000000:2.0:1787847450.887466:0:12960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787847450.887470:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847450.887474:0:12960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787847450.887478:0:12960:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d87c60919d0) has no exports 00000100:00100000:2.0:1787847450.887566:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d87c8f87400:5844] 1 exiting: rc = 0 00000100:00100000:2.0:1787847450.887663:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d87c51f2200:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1787847450.890761:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d87c8f7e800:5845] 2 exiting: rc = 0 00000100:00100000:1.0:1787847450.890900:0:7214:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d86c12ae400:7214] 3 exiting: rc = 0 00000100:00100000:3.0:1787847450.891023:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891031:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891037:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891059:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891066:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891072:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891080:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891090:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891098:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891107:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891114:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891121:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891128:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891135:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891141:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891147:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891154:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891161:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891172:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891180:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891189:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891269:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891275:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891291:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891297:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891303:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891310:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891320:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891330:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891338:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891344:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891354:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891367:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891372:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891377:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891382:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891396:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891413:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891420:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891425:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891429:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891434:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891438:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891442:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891447:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891452:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891457:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891461:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891466:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891471:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891476:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891481:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891497:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891503:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891508:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891513:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891518:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891522:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891528:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891535:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891540:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.891554:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787847450.898585:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d87c8f7f600:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1787847450.898732:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d87c8f7e000:5847] 1 exiting: rc = 0 00000100:00100000:3.0:1787847450.899071:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899082:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899089:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899094:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899100:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899106:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899112:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899117:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899123:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899144:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899150:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899156:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899164:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899169:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.899174:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901867:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901875:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901888:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901907:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901914:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901921:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.901928:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902066:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902071:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902076:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902086:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902093:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902098:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902103:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902108:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902113:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902118:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902123:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902128:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902133:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902138:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902142:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902147:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902151:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902156:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902160:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902164:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902169:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902174:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902265:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902272:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902277:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902290:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902325:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902333:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902338:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902343:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902349:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902354:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902359:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902363:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902368:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902373:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902378:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902382:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902388:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.902393:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787847450.903756:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d87c8f87e00:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1787847450.904275:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d87c8f87600:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1787847450.904417:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904427:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904435:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904442:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904450:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904459:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904494:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904505:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904514:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904522:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904531:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904538:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904547:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904641:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904648:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904665:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904672:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904680:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904703:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904710:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904716:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904723:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904729:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904736:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904811:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904816:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904821:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904827:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904833:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904838:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904861:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904867:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904874:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904880:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.904887:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905037:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905043:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905048:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905056:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905061:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905065:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905071:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905089:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905097:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905103:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905109:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905114:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905120:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905125:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905131:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905143:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905148:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905153:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905157:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905176:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905183:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905189:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905264:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905270:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905276:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905282:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905287:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905293:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.905310:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787847450.923509:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d87c8f7f400:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1787847450.923677:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d87c8f86c00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1787847450.923770:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923778:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923783:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923787:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923793:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923798:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923803:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923808:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923813:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923817:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923823:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923828:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923833:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923838:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923844:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923849:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923854:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923860:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923865:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923870:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923874:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923879:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923884:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923904:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923908:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923912:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923917:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923921:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923926:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923957:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923963:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923967:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923972:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923977:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923981:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923986:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923990:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923995:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.923999:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924004:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924008:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924012:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924016:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924021:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924026:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924031:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924035:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924039:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924044:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924048:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924054:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924059:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924063:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924067:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924072:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924076:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924082:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924087:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924100:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924105:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924110:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924114:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924120:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.924124:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787847450.924585:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d87c8f7fa00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1787847450.924679:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d87c8f7e600:5853] 1 exiting: rc = 0 00000100:00100000:2.0:1787847450.925137:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925143:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925147:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925153:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925158:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925163:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925169:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925174:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925179:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925184:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925189:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925265:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925271:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925275:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925281:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925286:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925291:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925296:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925301:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925306:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925311:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925316:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925320:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925325:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925329:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925334:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925339:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925344:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925349:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925365:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925370:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925375:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925380:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925385:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925390:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925395:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925400:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925405:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925409:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925415:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925420:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925425:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925430:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925434:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925439:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925444:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925449:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925455:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925460:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925465:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925470:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925476:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925481:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925494:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925499:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925504:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925509:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925514:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925521:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925525:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925530:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925534:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925539:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.925544:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787847450.926698:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d87c8f5f600:5854] 0 exiting: rc = 1 00000100:00100000:3.0:1787847450.926819:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d87c8f53a00:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1787847450.932327:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932337:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932342:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932346:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932352:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932357:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932362:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932366:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932370:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932374:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932379:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932617:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932622:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932627:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932633:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932638:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932643:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932648:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932652:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932657:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932662:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932667:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932674:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932679:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932685:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932689:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932695:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932700:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932705:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932712:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932718:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932724:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932730:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932736:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932742:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932759:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932765:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932770:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932776:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932780:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932784:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932789:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932793:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932798:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932803:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932811:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932818:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932825:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932831:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932837:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932845:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932852:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932861:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932871:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932880:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932889:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932905:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932912:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.932917:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.933841:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.933849:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.933854:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.933859:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847450.933864:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787847450.936357:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d87c2e3d800:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1787847450.938498:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d87c8f5e200:5858] 2 exiting: rc = 0 00000100:00100000:2.0:1787847450.939163:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d87c2e3d000:5857] 1 exiting: rc = 0 00000100:00100000:3.0:1787847450.939384:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939393:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939401:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939408:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939416:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939423:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939430:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939436:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939444:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939451:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939470:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939480:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939496:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939503:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939511:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939519:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939538:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939547:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939560:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939570:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939580:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939587:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939592:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939597:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939602:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939608:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939613:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939619:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939624:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939629:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939635:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939641:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939646:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939651:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939672:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939680:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939686:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939691:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939696:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939701:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939707:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939712:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939718:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939724:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939730:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939736:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939743:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939748:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939755:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939760:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939766:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939778:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939784:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939790:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939798:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939804:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939810:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939816:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939821:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939828:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939834:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939839:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939846:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847450.939859:0:12960:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787847450.948551:0:12960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787847450.948566:0:12960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787847450.948572:0:12960:0:(genops.c:885:class_export_put()) final put ffff8d87c6ab1000/MDS_uuid 00000020:00000080:0.0:1787847450.948587:0:12960:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c6ab1000/MDS_uuid for MDS 00000020:01000000:0.0:1787847450.948594:0:12960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787847450.948714:0:12960:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787847451.095321:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787847451.225077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787847451.225084:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787847451.225088:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d87ef029000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787847451.225093:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 360 00000100:00100000:1.0:1787847451.225093:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616390656:0@lo:400:kworker.0 00000100:00080000:3.0:1787847451.225099:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787847451.225106:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d87ef029000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847451.225125:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d88007ae1c0 x1874693616390784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787847451.225140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000400:00000100:1.0:1787847451.225141:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874693616390656 offset 0 length 224: 4 00000100:00080000:3.0:1787847451.225143:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787847451.225145:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d86c18b1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787847451.225148:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 360 00000100:00080000:3.0:1787847451.225150:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787847451.225153:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d86c18b1000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:3.0:1787847451.225162:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d88007afc00 x1874693616390912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787847451.225197:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616390784:0@lo:38:kworker.0 00000400:00000100:3.0:1787847451.225223:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874693616390784 offset 0 length 520: 4 00000100:00100000:3.0:1787847451.225237:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616390912:0@lo:38:kworker.0 00000400:00000100:3.0:1787847451.225252:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874693616390912 offset 0 length 520: 4 00010000:00010000:2.0:1787847452.120213:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847453.143241:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787847453.588650:0:13116:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787847453.602913:0:13116:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787847453.603115:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847453.603133:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847453.603141:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847453.603149:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847453.603202:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787847453.603209:0:13116:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787847453.603236:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787847453.603251:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d88007ae1c0 x1874693616390784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787847466 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847453.603273:0:13116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787847453.603281:0:13116:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787847453.603289:0:13116:0:(import.c:65:import_set_state_nolock()) ffff8d87ef029000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787847453.603294:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787847453.603318:0:13116:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d88007ae1c0 x1874693616390784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787847466 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847453.603326:0:13116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787847453.603330:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1787847453.603986:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ae1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616390784:0@lo:38:kworker.0 00010000:00010000:1.0:1787847453.606252:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847453.606275:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847453.606284:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847453.606291:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.606700:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847453.606711:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.606719:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1787847453.606723:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.606731:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847453.606739:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847453.606744:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787847453.606747:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787847453.606751:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787847453.606798:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.606805:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787847453.607045:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616391040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847453.607137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847453.607255:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616391040 00000100:00100000:3.0:1787847453.607263:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616391040 00000100:00100000:3.0:1787847453.607310:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787847453.607318:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1874693616391040:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787847453.607325:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787847453 with bad export cookie 1744545109485426800 00010000:00010000:1.0:1787847453.610647:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787847453.610679:0:13116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847453.610726:0:13116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847453.610735:0:13116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847453.610743:0:13116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611037:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611047:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9861baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bb1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611064:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847453.611070:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611085:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0031e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1787847453.611089:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611099:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847453.611107:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847453.611113:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787847453.611116:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787847453.611159:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611167:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847453.611197:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611204:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c0031e00/0x1835de88b9861bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861bbf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611214:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847453.611217:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611223:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1787847453.611226:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611243:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847453.611250:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847453.611255:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787847453.611257:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787847453.611269:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611275:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847453.611295:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847453.611303:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847453.611306:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847453.611448:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847453.611492:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616391168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787847453.611582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847453.611692:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616391168 00000100:00100000:2.0:1787847453.611701:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616391168 00000100:00100000:2.0:1787847453.611741:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787847453.611749:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88003683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1874693616391168:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787847453.611756:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787847453 with bad export cookie 1744545109485426800 00000100:00100000:2.0:1787847453.611804:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88003683c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1874693616391168:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (222us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787847453.611811:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:1.0:1787847453.611923:0:13116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787847453.611942:0:13116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9861dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x1835de88b9861dd3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847453.611955:0:13116:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1787847453.611960:0:13116:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1787847453.611966:0:13116:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787847453.611999:0:13116:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787847453.612004:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787847453.612011:0:13116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787847453.612018:0:13116:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787847453.612024:0:13116:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d86c18b99d0) has no exports 00000020:00080000:1.0:1787847453.612055:0:13116:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d86c18b99d0) has no exports 00000100:00080000:2.0:1787847453.618024:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787847453.618033:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d87c51cc000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787847453.618039:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1787847453.618110:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787847453.618488:0:13116:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87c6ec47e0 - data ffff8d87ffdbaaf8/ffff8d87f998b800 00000020:01000000:1.0:1787847453.618673:0:13116:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87c3c7b180 - data ffff8d87f129f870/ffff8d86c240b000 00000100:00100000:3.0:1787847453.620508:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ad680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1874693616391040:12345-0@lo:103:ldlm_bl.0 Request processed in 13181us (13363us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787847453.620526:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787847453.620625:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787847453.620667:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787847453.627754:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.121@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787847453.627762:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787847453.627774:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d88007af0c0 x1874693616390656/t0(0) o400->MGC192.168.201.121@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787847467 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847453.627792:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d86c1dbde00 x1874693616391040/t0(0) o103->MGC192.168.201.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787847469 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847453.627804:0:3303:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d86c1dbfc00 x1874693616391168/t0(0) o103->MGC192.168.201.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787847469 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787847453.627814:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787847453.627818:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787847453.627819:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787847453.627982:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:419007c4-9cf4-45fe-a98f-f6eaa183effb:0:1874693616391296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787847453.628056:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007af0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:419007c4-9cf4-45fe-a98f-f6eaa183effb:3301:1874693616390656:0@lo:400:kworker.0 00000100:00080000:3.0:1787847453.628200:0:3302:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d87c51cc000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1787847453.628214:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:419007c4-9cf4-45fe-a98f-f6eaa183effb:3302:1874693616391040:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1787847453.628589:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8d87c51cc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787847453.628596:0:3303:0:(import.c:510:import_select_connection()) MGC192.168.201.121@tcp: connect to NID 0@lo last attempt 134 00000100:00080000:2.0:1787847453.628608:0:3303:0:(import.c:624:import_select_connection()) MGC192.168.201.121@tcp: import ffff8d87c51cc000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847453.628649:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d880036a1c0 x1874693616391424/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847453.628712:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:419007c4-9cf4-45fe-a98f-f6eaa183effb:3303:1874693616391168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847453.628775:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:419007c4-9cf4-45fe-a98f-f6eaa183effb:3299:1874693616391424:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1787847453.628839:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874693616391424 offset 0 length 520: 4 00100000:10000000:1.0:1787847453.648149:0:13116:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787847453.678448:0:13116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861996 00000020:00000080:2.0:1787847453.678463:0:13116:0:(genops.c:885:class_export_put()) final put ffff8d86c18b2000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787847453.678485:0:13116:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87ef8a4000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787847453.678489:0:13116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87ef8a4000 2 00000020:01000004:2.0:1787847453.678494:0:13116:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d87ef8a4000 from lustre-OST0000 00000020:00000080:2.0:1787847453.678525:0:13116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847453.678539:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787847453.678542:0:13116:0:(genops.c:885:class_export_put()) final put ffff8d86c18b7000/lustre-OST0000_UUID 00000020:00000080:2.0:1787847453.678546:0:13116:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c18b7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787847453.678555:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787847453.678607:0:13116:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787847453.678612:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787847453.678617:0:13116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847453.678622:0:13116:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787847453.678630:0:13116:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d86c1ca6000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787847453.678637:0:13116:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8d86c18bcd70) has exports, disconnecting them 00000020:00080000:2.0:1787847453.678642:0:13116:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d86c1ca6000), last request at 1787847238 00000020:00000080:2.0:1787847453.678647:0:13116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b98619c0 00000020:00080000:2.0:1787847453.678657:0:13116:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d86c1ca6000): rc 0 00000020:00000080:2.0:1787847453.678663:0:13116:0:(genops.c:885:class_export_put()) final put ffff8d86c1ca6000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787847453.679650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c18b2000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787847453.679665:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c1ca6000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787847453.712098:0:13116:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787847453.712115:0:13116:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787847453.712122:0:13116:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787847453.712135:0:13116:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787847453.712386:0:13116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847453.712398:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787847453.712406:0:13116:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87ef8a4000 1 00000020:00000080:2.0:1787847453.712431:0:13116:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861950 00000020:00000080:2.0:1787847453.712454:0:13116:0:(genops.c:885:class_export_put()) final put ffff8d87c600a000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1787847453.712461:0:13116:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787847453.712467:0:13116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847453.712472:0:13116:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787847453.712477:0:13116:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d87c7c00000) has no exports 00000020:00000080:1.0:1787847453.712581:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87ef029000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787847453.712595:0:8:0:(genops.c:885:class_export_put()) final put ffff8d86c18b0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787847453.712599:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d86c18b0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787847453.712612:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787847453.712679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c600a000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787847453.728061:0:13116:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847453.728084:0:13116:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787847453.728091:0:13116:0:(genops.c:885:class_export_put()) final put ffff8d87ef8a7000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787847453.728098:0:13116:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ef8a7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787847453.728109:0:13116:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787847453.728280:0:13116:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d87ef8a3800 00000020:02000400:2.0:1787847453.728343:0:13116:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787847454.167267:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847455.192480:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847456.217668:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787847456.344032:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 419007c4-9cf4-45fe-a98f-f6eaa183effb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787847456.344043:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 419007c4-9cf4-45fe-a98f-f6eaa183effb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787847456.344045:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787847456.344048:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:1.0:1787847456.368210:0:13267:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787847456.385379:0:13267:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787847456.385484:0:13267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.385499:0:13267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.385508:0:13267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.385515:0:13267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.385538:0:13267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787847456.385543:0:13267:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787847456.385562:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787847456.385573:0:13267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d88007afc00 x1874693616390912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787847466 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847456.385592:0:13267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787847456.385598:0:13267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787847456.385604:0:13267:0:(import.c:65:import_set_state_nolock()) ffff8d86c18b1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787847456.385610:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787847456.385614:0:13267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d88007afc00 x1874693616390912/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787847466 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787847456.385666:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847456.385674:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847456.385681:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:2.0:1787847456.385685:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847456.385694:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787847456.385702:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847456.385722:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787847456.385725:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787847456.385727:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787847456.385740:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d87c51cc000 00010000:00010000:2.0:1787847456.385744:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847456.385750:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6c00/0x1835de88b9861b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861b87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847456.385762:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847456.385764:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847456.385766:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847456.386207:0:13267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787847456.388260:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007afc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616390912:0@lo:38:kworker.0 00000100:00100000:1.0:1787847456.388271:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787847456.389738:0:13267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389754:0:13267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389763:0:13267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389770:0:13267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389850:0:13267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787847456.389858:0:13267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389865:0:13267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389871:0:13267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.389877:0:13267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.390002:0:13267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787847456.390007:0:13267:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1787847456.390044:0:13267:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1787847456.390048:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787847456.390053:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787847456.390058:0:13267:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787847456.390062:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d88008633a0) has no exports 00000020:00080000:1.0:1787847456.390088:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d88008633a0) has no exports 00010000:00010000:3.0:1787847456.394429:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847456.394443:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394471:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c0030e00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847456.394474:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394490:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847456.394496:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847456.394499:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787847456.394501:0:7621:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1787847456.394503:0:7621:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1787847456.394517:0:7621:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d87c51cc000 00010000:00010000:3.0:1787847456.394520:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394524:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c0030e00/0x1835de88b9861b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861b95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394536:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847456.394539:0:7621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394542:0:7621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7800 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847456.394544:0:7621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394556:0:7621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847456.394565:0:7621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847456.394569:0:7621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787847456.394570:0:7621:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787847456.394571:0:7621:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787847456.394574:0:7621:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d87c51cc000 00010000:00010000:3.0:1787847456.394576:0:7621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394579:0:7621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7800/0x1835de88b9861db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861dbe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847456.394587:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847456.394588:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847456.394590:0:7621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787847456.395947:0:13267:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d87c6ec4480 - data ffff8d87ffde2438/ffff8d87c8250000 00000020:01000000:1.0:1787847456.396110:0:13267:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d880084ca80 - data ffff8d87f106ed80/ffff8d87f7fe5800 00010000:00010000:2.0:1787847456.397384:0:7622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787847456.412840:0:13267:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787847456.434881:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861a6f 00000020:00000080:1.0:1787847456.434892:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d8800366000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787847456.434913:0:13267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87ff957000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787847456.434917:0:13267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87ff957000 2 00000020:01000004:1.0:1787847456.434921:0:13267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d87ff957000 from lustre-OST0001 00000020:00000080:1.0:1787847456.434970:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787847456.434980:0:13267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787847456.434983:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d8800364000/lustre-OST0001_UUID 00000020:00000080:1.0:1787847456.434986:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff8d8800364000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787847456.434993:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787847456.435088:0:13267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 419007c4-9cf4-45fe-a98f-f6eaa183effb->MGS 00010000:00010000:1.0:1787847456.435104:0:13267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9861973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847456.435116:0:13267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9861973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847456.435123:0:13267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787847456.435126:0:13267:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787847456.435129:0:13267:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787847456.435144:0:13267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d87c51cc000 00010000:00010000:1.0:1787847456.435148:0:13267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9861973 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b986197a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847456.435179:0:13267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847456.435186:0:13267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847456.435192:0:13267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787847456.435194:0:13267:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787847456.435195:0:13267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787847456.435214:0:13267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d87c51cc000 00010000:00010000:1.0:1787847456.435217:0:13267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c165de00/0x1835de88b9861bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1835de88b9861c05 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787847456.435237:0:13267:0:(import.c:65:import_set_state_nolock()) ffff8d87c51cc000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787847456.435242:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787847456.435244:0:13267:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787847456.435246:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787847456.435249:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787847456.435262:0:13267:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d880036a1c0 x1874693616391424/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787847463 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787847456.435278:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787847456.435282:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787847456.435321:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:419007c4-9cf4-45fe-a98f-f6eaa183effb:3299:1874693616391424:0@lo:250:ptlrpcd_00_03.0 00000020:00000080:2.0:1787847456.435410:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d8800366000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1787847456.435412:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787847456.435423:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861862 00000020:00000080:1.0:1787847456.435429:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d87c6ab4800/419007c4-9cf4-45fe-a98f-f6eaa183effb 00000020:01000000:1.0:1787847456.435439:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.121@tcp (flags='') 00000020:00000080:1.0:1787847456.435444:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787847456.435449:0:13267:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.121@tcp: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1787847456.435450:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c6ab4800/419007c4-9cf4-45fe-a98f-f6eaa183effb for MGC192.168.201.121@tcp 00000020:00080000:1.0:1787847456.435454:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d87c51c33a0) has no exports 10000000:01000000:2.0:1787847456.435496:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1787847456.435539:0:13267:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.121@tcp: client import never connected 00000100:00080000:1.0:1787847456.435548:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787847456.435550:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787847456.435552:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787847456.435554:0:13267:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787847456.435600:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787847456.435605:0:13267:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.121@tcp (uuid 419007c4-9cf4-45fe-a98f-f6eaa183effb) 00000020:01000000:1.0:1787847456.435610:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787847456.435613:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787847456.435617:0:13267:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787847456.435622:0:13267:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d88007a0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:2.0:1787847456.435624:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d87c51cc000 for MGC192.168.201.121@tcp 00000020:00080000:1.0:1787847456.435630:0:13267:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8d88008619d0) has exports, disconnecting them 00000020:00000080:2.0:1787847456.435636:0:38:0:(genops.c:885:class_export_put()) final put ffff8d87c32f4800/419007c4-9cf4-45fe-a98f-f6eaa183effb 00000020:00080000:1.0:1787847456.435637:0:13267:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d88007a0800), last request at 1787847258 00000020:00000080:2.0:1787847456.435641:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c32f4800/419007c4-9cf4-45fe-a98f-f6eaa183effb for MGC192.168.201.121@tcp 00000020:00000080:1.0:1787847456.435644:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861a99 00000020:01000000:2.0:1787847456.435647:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.121@tcp (419007c4-9cf4-45fe-a98f-f6eaa183effb) 00000020:00080000:1.0:1787847456.435658:0:13267:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d88007a0800): rc 0 00000020:00000080:1.0:1787847456.435662:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d88007a0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787847456.436070:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d88007a0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787847456.439068:0:13267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787847456.439076:0:13267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787847456.439080:0:13267:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787847456.439088:0:13267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787847456.440497:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787847456.440649:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d86c18b1000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1787847456.441382:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787847456.441518:0:7622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1787847456.441735:0:7621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1787847456.441880:0:11657:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8d87f9c36a00:11657] 2 exiting: rc = 0 00000100:00100000:3.0:1787847456.442344:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d87c69b3000:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1787847456.442412:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d87d3c2dc00:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1787847456.442533:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.443544:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d87f508be00:5828] 0 exiting: rc = 1 00000100:00100000:3.0:1787847456.443747:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d87f508a600:5830] 2 exiting: rc = 0 00000100:00100000:3.0:1787847456.443804:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d87dea37200:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1787847456.445518:0:8440:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d87efbf7400:8440] 3 exiting: rc = 0 00000100:00100000:3.0:1787847456.451460:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451484:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451491:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451496:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451501:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451508:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451512:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451517:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451524:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451530:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451542:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451564:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451573:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451587:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451594:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451600:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451607:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451615:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451620:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451625:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451630:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.451635:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452041:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452050:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452055:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452061:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452066:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452071:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452076:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452081:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452086:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452092:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452097:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452102:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452107:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.452112:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453657:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453676:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453681:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453686:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453692:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453697:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453702:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453708:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453713:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453719:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453723:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453729:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453734:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453740:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453745:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453750:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453755:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453761:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453765:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453771:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453776:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453782:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453788:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453805:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453810:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453815:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453820:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.453826:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787847456.455005:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847456.455017:0:13267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787847456.455022:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d8800360000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787847456.455028:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff8d8800360000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787847456.455033:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1787847456.455070:0:13267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87ff957000 1 00000020:00000080:2.0:1787847456.455076:0:13267:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1835de88b9861a3e 00000020:00000080:2.0:1787847456.455082:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d87e7603000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787847456.455091:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787847456.455096:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847456.455101:0:13267:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787847456.455104:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d86c24c99d0) has no exports 00000020:00000080:3.0:1787847456.455623:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87e7603000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787847456.485257:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847456.485273:0:13267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787847456.485279:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d87ff956800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787847456.485284:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87ff956800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787847456.485290:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787847456.485488:0:13267:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d87ff956000 00000020:01000000:2.0:1787847456.485510:0:13267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787847456.485514:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787847456.485518:0:13267:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787847456.485522:0:13267:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d87c51c0000) has no exports 00000020:00000080:2.0:1787847456.485560:0:13267:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787847456.485567:0:13267:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787847456.485570:0:13267:0:(genops.c:885:class_export_put()) final put ffff8d87c600d000/OSS_uuid 00000020:00000080:2.0:1787847456.485573:0:13267:0:(genops.c:844:class_export_destroy()) destroying export ffff8d87c600d000/OSS_uuid for OSS 00000020:01000000:2.0:1787847456.485584:0:13267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787847456.485613:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787847456.485768:0:7920:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d87f9cbfe00:7920] 3 exiting: rc = 0 00000100:00100000:2.0:1787847456.485842:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d87ef04b800:6677] 0 exiting: rc = 1 00000100:00100000:2.0:1787847456.490115:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d87e6d79000:6679] 2 exiting: rc = 0 00000100:00100000:1.0:1787847456.490413:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d87e6d79800:6678] 1 exiting: rc = 0 00000100:00100000:2.0:1787847456.493804:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493816:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493823:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493832:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493837:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493843:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493848:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493853:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493859:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493864:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493869:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493874:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493880:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493885:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493890:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493895:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493901:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493907:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493921:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493928:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493951:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493958:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493964:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493970:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493976:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493983:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493991:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.493998:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494007:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494013:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494019:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494025:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494033:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494039:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494048:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494071:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494657:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494666:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494671:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494676:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494681:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494686:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494692:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494697:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494702:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494707:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494712:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494718:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494723:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494728:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494733:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494738:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494744:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494750:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494755:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494760:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494765:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494770:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494775:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494780:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494784:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494789:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494806:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.494812:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787847456.501472:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d87f519de00:6681] 1 exiting: rc = 0 00000100:00100000:2.0:1787847456.502055:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d87f519c200:6680] 0 exiting: rc = 1 00000100:00100000:2.0:1787847456.502194:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502207:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502213:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502219:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502224:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502244:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502250:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502256:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502262:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502266:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502271:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502277:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502283:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502288:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502293:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502299:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502303:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502308:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502314:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502319:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502324:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502329:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502333:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502338:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502343:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502348:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502353:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502359:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502365:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502372:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502377:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502383:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502399:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502405:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502411:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502417:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502422:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502428:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502433:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502439:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502452:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502458:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502463:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502468:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502473:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502478:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502483:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502489:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502493:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502499:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502505:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502511:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502521:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502528:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502644:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502652:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502658:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502666:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502672:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502678:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502684:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502689:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502695:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.502701:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.503994:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d87c4e9a000:6682] 0 exiting: rc = 1 00000100:00100000:3.0:1787847456.505894:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d87e6d79200:6683] 1 exiting: rc = 0 00000100:00100000:2.0:1787847456.509190:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d87f7f88800:6684] 2 exiting: rc = 0 00000100:00100000:3.0:1787847456.509351:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509360:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509367:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509373:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509398:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509419:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509425:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509430:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509435:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509441:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509446:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509451:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509457:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509463:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509468:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509474:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509479:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509484:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509490:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509496:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509502:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509519:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509525:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509531:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509536:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509542:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509548:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509553:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509559:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509565:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509571:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509576:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509596:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509602:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509607:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509613:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509618:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509624:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509629:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509634:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509647:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509653:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509661:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509666:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509672:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509693:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509700:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509706:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509711:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509717:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509724:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509729:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509735:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509741:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509746:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509752:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509758:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509764:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509770:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509775:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509781:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509787:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509793:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.509807:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787847456.519479:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d87ef977200:6685] 0 exiting: rc = 1 00000100:00100000:1.0:1787847456.521188:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d87ef977800:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1787847456.521440:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521448:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521454:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521459:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521463:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521469:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521474:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521479:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521484:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521503:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521508:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521513:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521518:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521523:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521528:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521533:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521538:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521543:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521549:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521554:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521558:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521564:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521570:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521576:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521753:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521759:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521765:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521771:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521777:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521782:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521788:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521793:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521798:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521804:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521809:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521813:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521818:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521823:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521828:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521833:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521838:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521843:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521849:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521854:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521887:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521894:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521900:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521905:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521910:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521915:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521921:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521926:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521960:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521967:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521973:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521979:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521984:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521990:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.521996:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.522001:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.522006:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.522012:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.522017:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.522029:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.522788:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d87e7da8600:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1787847456.522962:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d87e7da9a00:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1787847456.523062:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523071:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523077:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523082:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523088:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523094:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523100:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523105:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523111:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523128:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523135:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523141:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523146:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523152:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523168:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523173:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523179:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523185:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523191:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523197:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523202:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523221:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523228:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523234:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523240:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523246:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523252:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523258:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523263:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523270:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523276:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523281:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523287:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523310:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523318:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523323:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523329:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523334:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523340:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523345:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523354:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523362:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523368:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523379:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523394:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523418:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523426:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523432:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523438:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523452:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523457:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523464:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523470:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523475:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523481:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523486:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523491:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523512:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523520:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523527:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523533:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523539:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523544:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787847456.523550:0:13267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787847456.541323:0:13267:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787847472.087222:0:13879:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787847480.869347:0:14341:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787847480.869355:0:14341:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787847480.870863:0:14341:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d87e6e62000 00000020:01000004:2.0:1787847480.870883:0:14341:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787847480.870892:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787847480.870906:0:14341:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d86c24c99d0) 00000020:00000080:2.0:1787847480.870920:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787847480.888120:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787847480.889750:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787847480.890195:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 395: rc = 0 00100000:10000000:2.0:1787847480.890333:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 395: rc = 0 00100000:10000000:2.0:1787847480.890532:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 395: rc = 0 00100000:10000000:2.0:1787847480.890610:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 395: rc = 0 00100000:10000000:2.0:1787847480.890783:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787847480.890851:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 395: rc = 0 00100000:10000000:2.0:1787847480.893572:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 395: rc = 0 00100000:10000000:2.0:1787847480.893831:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 397: rc = 0 00100000:10000000:2.0:1787847480.895068:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 468: rc = 0 00100000:10000000:2.0:1787847480.895167:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 468: rc = 0 00100000:10000000:2.0:1787847480.895657:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 472: rc = 0 00100000:10000000:2.0:1787847480.895900:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 472: rc = 0 00100000:10000000:2.0:1787847480.896201:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 472: rc = 0 00100000:10000000:2.0:1787847480.896423:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 472: rc = 0 00100000:10000000:2.0:1787847480.896634:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 472: rc = 0 00100000:10000000:2.0:1787847480.896875:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 472: rc = 0 00100000:10000000:2.0:1787847480.897336:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 472: rc = 0 00100000:10000000:2.0:1787847480.897614:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 472: rc = 0 00100000:10000000:2.0:1787847480.897827:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 472: rc = 0 00100000:10000000:2.0:1787847480.898110:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 472: rc = 0 00100000:10000000:2.0:1787847480.898327:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 472: rc = 0 00100000:10000000:2.0:1787847480.898607:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 472: rc = 0 00100000:10000000:2.0:1787847480.899033:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:2.0:1787847480.899275:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:2.0:1787847480.899585:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:2.0:1787847480.899827:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:2.0:1787847480.900139:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:2.0:1787847480.900468:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:2.0:1787847480.900713:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:2.0:1787847480.901118:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:2.0:1787847480.901353:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:2.0:1787847480.901701:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:2.0:1787847480.901896:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:2.0:1787847480.902096:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:2.0:1787847480.902296:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:2.0:1787847480.902528:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:2.0:1787847480.902716:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:2.0:1787847480.902903:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:2.0:1787847480.903156:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:2.0:1787847480.903347:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:2.0:1787847480.903579:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:2.0:1787847480.903789:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:2.0:1787847480.904005:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:2.0:1787847480.904183:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:2.0:1787847480.904358:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:2.0:1787847480.904654:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:2.0:1787847480.904857:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:2.0:1787847480.905071:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:2.0:1787847480.905251:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:2.0:1787847480.905440:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:2.0:1787847480.905607:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:2.0:1787847480.905827:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:2.0:1787847480.906060:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:2.0:1787847480.906228:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:2.0:1787847480.906491:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 335: rc = 0 00100000:10000000:2.0:1787847480.906894:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1787847480.907418:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 469: rc = 0 00100000:10000000:2.0:1787847480.908357:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1787847480.908463:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 469: rc = 0 00100000:10000000:2.0:1787847480.908604:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1787847480.908648:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 469: rc = 0 00100000:10000000:2.0:1787847480.908925:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1787847480.909088:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 581: rc = 0 00100000:10000000:2.0:1787847480.909244:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1787847480.909288:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 581: rc = 0 00100000:10000000:2.0:1787847480.909443:0:14341:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1787847480.909485:0:14341:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 581: rc = 0 00000020:00000080:2.0:1787847480.909691:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787847480.909816:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787847480.909825:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862b63 00000020:01000004:2.0:1787847480.909831:0:14341:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787847480.909835:0:14341:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787847480.909840:0:14341:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d87e6e62000 from MGS 00000020:01000004:2.0:1787847480.909842:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787847480.909850:0:14341:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d86c24ccd70) 00000020:00000080:2.0:1787847480.909858:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787847480.909897:0:14341:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87e6e62000 from MGS, refs=2 00080000:01000000:2.0:1787847480.909900:0:14341:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787847480.909904:0:14341:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862b71 00000100:00100000:2.0:1787847480.910250:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787847480.910346:0:14341:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787847480.910349:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787847480.910773:0:14341:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787847480.910779:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787847480.911256:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787847480.911356:0:14341:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787847480.911359:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787847480.911779:0:14341:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787847480.911786:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787847480.912002:0:14341:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787847480.912009:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787847480.912449:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847480.912453:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847480.912455:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847480.912634:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847480.912636:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847480.912637:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847480.913095:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787847480.915978:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787847480.919771:0:14341:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787847480.919789:0:14341:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787847480.919791:0:14341:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787847480.921893:0:14350:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787847480.922068:0:14341:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787847480.922145:0:14341:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787847480.922650:0:14341:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787847480.922909:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787847480.923521:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787847480.923526:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787847480.924431:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787847480.924438:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787847480.925008:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787847480.925013:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787847480.925676:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787847480.925695:0:14341:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.121@tcp' 00000020:01000004:0.0:1787847480.925698:0:14341:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787847480.925728:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.121@tcp (typ=mgc) 00000020:00000080:0.0:1787847480.925741:0:14341:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.121@tcp (ffff8d86c18b8000) 00000020:00000080:0.0:1787847480.925756:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:2.0:1787847480.926165:0:14355:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1787847480.926236:0:14341:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d87f913e800@MGC192.168.201.121@tcp: add connection 192.168.201.121@tcp at head 00010000:00010000:0.0:1787847480.926464:0:14341:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.121@tcp-0 is initialized 00000040:01000000:0.0:1787847480.926471:0:14341:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787847480.928139:0:14356:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787847480.928224:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.121@tcp (uuid 1d674ef9-f2fc-448e-8206-e13ebe069dba) 00000020:00000080:2.0:1787847480.928249:0:14341:0:(genops.c:1385:class_connect()) connect: client 1d674ef9-f2fc-448e-8206-e13ebe069dba, cookie 0x1835de88b9862b7f 00000100:00080000:2.0:1787847480.928261:0:14341:0:(import.c:510:import_select_connection()) MGC192.168.201.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787847480.928268:0:14341:0:(import.c:624:import_select_connection()) MGC192.168.201.121@tcp: import ffff8d87f913e800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847480.928302:0:14341:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d880036ad00 x1874693616391552/t0(0) o250->MGC192.168.201.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847480.928347:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d674ef9-f2fc-448e-8206-e13ebe069dba:3299:1874693616391552:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787847480.928480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847480.928524:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616391552 00000100:00100000:3.0:1787847480.928532:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616391552 00000100:00080000:2.0:1787847480.928543:0:14341:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1d674ef9-f2fc-448e-8206-e13ebe069dba->MGS 00000100:00100000:3.0:1787847480.928563:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1787847480.928563:0:14341:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:3.0:1787847480.928572:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880012e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1874693616391552:12345-0@lo:250:mount.lustre.0 00000020:01000004:2.0:1787847480.928584:0:14341:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787847480.928597:0:14341:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d86c24c8000) 00010000:00080000:3.0:1787847480.928601:0:14351:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from 1d674ef9-f2fc-448e-8206-e13ebe069dba@0@lo t0 exp 0000000000000000 cur 395 last 0 00000020:00000080:2.0:1787847480.928607:0:14341:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000020:00000080:3.0:1787847480.928622:0:14351:0:(genops.c:1385:class_connect()) connect: client 1d674ef9-f2fc-448e-8206-e13ebe069dba, cookie 0x1835de88b9862b8d 00000100:00080000:3.0:1787847480.928906:0:14351:0:(import.c:65:import_set_state_nolock()) ffff8d87c8fb4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787847480.929010:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880012e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+5:3299:x1874693616391552:12345-0@lo:250:mount.lustre.0 Request processed in 437us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847480.929018:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787847480.929035:0:3299:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787847480.929044:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.121@tcp: connect to target with instance 0 00000100:00080000:2.0:1787847480.929050:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787847480.929054:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787847480.929058:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87f913e800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787847480.929060:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787847480.929069:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787847480.929074:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1d674ef9-f2fc-448e-8206-e13ebe069dba:3299:1874693616391552:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787847480.939553:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847480.941152:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787847480.941160:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787847480.942711:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787847480.942723:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787847480.943798:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787847480.943806:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787847480.944537:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787847480.944716:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787847480.944722:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787847480.945199:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787847480.945206:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787847480.973819:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787847480.974234:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787847480.974242:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787847480.975522:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787847480.975531:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787847480.976393:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787847480.976555:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787847480.976560:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787847480.977463:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787847480.977472:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787847480.977910:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847480.978100:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787847480.978105:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787847480.978729:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787847480.978736:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787847480.979311:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847480.979582:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787847480.979588:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787847480.980096:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787847480.980103:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787847480.999062:0:14341:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787847480.999286:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787847480.999292:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787847481.001138:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787847481.001151:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787847481.002286:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787847481.002296:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787847481.003443:0:14341:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787847481.003467:0:14341:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787847481.003475:0:14341:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787847481.003597:0:14341:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787847481.003626:0:14341:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787847481.003629:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787847481.003633:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787847481.003633:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847481.003634:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847481.003635:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847481.003636:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847481.003637:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787847481.003638:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787847481.003639:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847481.003640:0:14341:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787847481.003641:0:14341:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787847481.003643:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787847481.003643:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787847481.003644:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847481.003645:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847481.003645:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847481.003646:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847481.003646:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787847481.003647:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787847481.003648:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847481.003648:0:14341:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787847481.003680:0:14341:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787847481.003701:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616391680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787847481.003766:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.003810:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.003881:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616391680 00000100:00100000:2.0:1787847481.003888:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616391680 00000100:00100000:2.0:1787847481.003979:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847481.003989:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+5:14341:x1874693616391680:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787847481.004051:0:14353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787847481.004055:0:14353:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787847481.004058:0:14353:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1787847481.004384:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787847481.004638:0:14353:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787847481.005561:0:14375:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787847481.005566:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787847481.005568:0:14375:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787847481.005587:0:14375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787847481.005820:0:14353:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787847481.005829:0:14353:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787847481.011374:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+5:14341:x1874693616391680:12345-0@lo:253:mount.lustre.0 Request processed in 7368us (7588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.011389:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847481.011525:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616391680:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787847481.011541:0:14341:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787847481.011544:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787847481.011546:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787847481.011547:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847481.011549:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847481.011550:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847481.011551:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847481.011552:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787847481.011554:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787847481.011556:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847481.011558:0:14341:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787847481.011594:0:14341:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d87e6e62000 from lustre-MDT0000 10000000:01000000:3.0:1787847481.011618:0:14341:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787847481.011632:0:14341:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787847481.011636:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d86c18b8000 10000000:01000000:3.0:1787847481.011640:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787847481.011647:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d86c18b8000 from 1 10000000:01000000:3.0:1787847481.011651:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787847481.011685:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.011696:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.011705:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847481.011723:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616391808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847481.011759:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.011830:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87deaed600 going to sleep for 11 seconds 00000100:00100000:0.0:1787847481.011879:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616391808 00000100:00100000:0.0:1787847481.011886:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616391808 00000100:00100000:0.0:1787847481.012034:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787847481.012045:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+5:14341:x1874693616391808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787847481.012058:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847481.012072:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6affa00/0x1835de88b9862b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862b94 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.012096:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6affa00/0x1835de88b9862b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862b94 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.012107:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6affa00/0x1835de88b9862b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862b94 expref: 6 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.012116:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affa00, rc 0) 00000100:00100000:0.0:1787847481.012192:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+6:14341:x1874693616391808:12345-0@lo:101:mount.lustre.0 Request processed in 149us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.012205:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847481.012353:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ade00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616391808:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787847481.012378:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.012387:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.012442:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616391936:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787847481.012470:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847481.012499:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0b10840 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.012605:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616391936 00000100:00100000:2.0:1787847481.012610:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616391936 00000100:00100000:2.0:1787847481.012643:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787847481.012650:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+6:14341:x1874693616391936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847481.012861:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+6:14341:x1874693616391936:12345-0@lo:501:mount.lustre.0 Request processed in 211us (390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787847481.012869:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847481.012966:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616391936:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787847481.012989:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787847481.013009:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013017:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847481.013031:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d87e6e62000 10000000:01000000:1.0:1787847481.013036:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787847481.013040:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d87e6e62000 10000000:01000000:1.0:1787847481.013043:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787847481.013045:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d87e6e62000 from 1 10000000:01000000:1.0:1787847481.013048:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787847481.013065:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013072:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013080:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.013091:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787847481.013115:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847481.013129:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0b10840 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.013187:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616392064 00000100:00100000:2.0:1787847481.013191:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616392064 00000100:00100000:2.0:1787847481.013208:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787847481.013228:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+6:14341:x1874693616392064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847481.013235:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847481.013247:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b200/0x1835de88b9862ba9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862ba2 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.013260:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b200/0x1835de88b9862ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862ba2 expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.013269:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b200/0x1835de88b9862ba9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862ba2 expref: 7 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.013286:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b200, rc 0) 00000100:00100000:2.0:1787847481.013323:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+7:14341:x1874693616392064:12345-0@lo:101:mount.lustre.0 Request processed in 96us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.013329:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847481.013502:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787847481.013513:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862ba9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013520:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862ba9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847481.013530:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787847481.013546:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862ba9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013558:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c14f5000/0x1835de88b9862ba2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862ba9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847481.013564:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787847481.013567:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787847481.013571:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d87e6e62000 10000000:01000000:1.0:1787847481.013573:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787847481.013575:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787847481.013577:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787847481.013590:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013597:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013603:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.013614:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787847481.013639:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847481.013658:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0b10840 going to sleep for 11 seconds 00000100:00100000:3.0:1787847481.013743:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616392192 00000100:00100000:3.0:1787847481.013748:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616392192 00000100:00100000:3.0:1787847481.013767:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847481.013774:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+7:14341:x1874693616392192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847481.013780:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847481.013790:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9862bb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862bb0 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.013804:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9862bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862bb0 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.013812:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7800/0x1835de88b9862bb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862bb0 expref: 8 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.013830:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7800, rc 0) 00000100:00100000:3.0:1787847481.013869:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+8:14341:x1874693616392192:12345-0@lo:101:mount.lustre.0 Request processed in 95us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847481.013875:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847481.013971:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787847481.013982:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.013989:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.014039:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787847481.014062:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847481.014084:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0b10840 going to sleep for 11 seconds 00000100:00100000:3.0:1787847481.014134:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616392320 00000100:00100000:3.0:1787847481.014138:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616392320 00000100:00100000:3.0:1787847481.014156:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787847481.014162:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+8:14341:x1874693616392320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847481.014679:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14341:x1874693616392320:12345-0@lo:501:mount.lustre.0 Request processed in 516us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847481.014687:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847481.014880:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787847481.014922:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787847481.015077:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847481.015142:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0b10840 going to sleep for 11 seconds 00000100:00100000:3.0:1787847481.015178:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616392448 00000100:00100000:3.0:1787847481.015182:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616392448 00000100:00100000:3.0:1787847481.018514:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787847481.018538:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14341:x1874693616392448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787847481.019087:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14341:x1874693616392448:12345-0@lo:503:mount.lustre.0 Request processed in 559us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847481.019096:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847481.019481:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616392448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847481.019893:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14376:1874693616392576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847481.020070:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847481.020142:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7202840 going to sleep for 11 seconds 00000100:00100000:0.0:1787847481.020183:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616392576 00000100:00100000:0.0:1787847481.020189:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616392576 00000100:00100000:0.0:1787847481.020328:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787847481.020339:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14376:x1874693616392576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.020699:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14376:x1874693616392576:12345-0@lo:502:llog_process_th.0 Request processed in 362us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.020707:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787847481.020799:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14376:1874693616392576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787847481.020826:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847481.020837:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.020840:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787847481.020845:0:14376:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787847481.020848:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847481.020862:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d8800860000) 00000020:00000080:3.0:1787847481.020885:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787847481.020892:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787847481.021001:0:14376:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787847481.021010:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862bc5 00000020:00000080:3.0:1787847481.021236:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787847481.021241:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847481.021245:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.021246:0:14376:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787847481.021249:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847481.021252:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.021253:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787847481.021257:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847481.021264:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d8800864d70) 00000020:00000080:3.0:1787847481.021273:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787847481.021277:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787847481.021279:0:14376:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787847481.021282:0:14376:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787847481.021288:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787847481.021327:0:14376:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87e6e62000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787847481.021339:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d88008619d0) 00000020:00000080:3.0:1787847481.021348:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787847481.021523:0:14376:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787847481.021531:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9862bda 00000020:00000080:3.0:1787847481.021631:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787847481.021637:0:14376:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787847481.021641:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1835de88b9862be1 00080000:01000000:3.0:1787847481.021645:0:14376:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787847481.021648:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862be8 00010000:00010000:3.0:1787847481.088697:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787847481.089155:0:14376:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787847481.089330:0:14376:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787847481.089807:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d88008633a0) 00000020:00000080:3.0:1787847481.089825:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787847481.089893:0:14376:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787847481.089900:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862bf6 00000020:00000080:2.0:1787847481.099174:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787847481.107225:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1835de88b9862bfd 00000020:00000080:3.0:1787847481.108918:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787847481.108964:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847481.108972:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.108974:0:14376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787847481.108979:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787847481.108981:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1787847481.108983:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787847481.108985:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787847481.108987:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787847481.108989:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.108991:0:14376:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787847481.108994:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787847481.108999:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.109001:0:14376:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787847481.109006:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787847481.109049:0:14376:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787847481.109062:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787847481.109065:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.109067:0:14376:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787847481.109069:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787847481.109074:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787847481.109077:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847481.109079:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787847481.109082:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787847481.109087:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:3.0:1787847481.109120:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787847481.109123:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847481.109154:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d88018833a0) 00000020:00000080:3.0:1787847481.109178:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787847481.109185:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787847481.109241:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787847481.109253:0:14376:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787847481.109260:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862c0b 00010000:00080000:3.0:1787847481.109290:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d8800360800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:3.0:1787847481.109519:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787847481.109912:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787847481.109990:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787847481.110904:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847481.111016:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787847481.111093:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787847481.113906:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787847481.113916:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787847481.115214:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787847481.115227:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787847481.115262:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787847481.115283:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9862c12 00000100:00080000:2.0:1787847481.115293:0:14376:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787847481.115300:0:14376:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d8800360800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847481.115335:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d880036a940 x1874693616392704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787847481.115362:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787847481.115469:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847481.115473:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847481.115475:0:14376:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787847481.115478:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787847481.115481:0:14376:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1787847481.115482:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787847481.115484:0:14376:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787847481.115494:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787847481.115497:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847481.115499:0:14376:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787847481.115501:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787847481.115505:0:14376:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787847481.115509:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847481.115510:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787847481.115512:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787847481.115516:0:14376:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.121@tcp to nid 0x20000c0a8c979 (192.168.201.121@tcp) 00000020:01000000:2.0:1787847481.115540:0:14376:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787847481.115542:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787847481.115553:0:14376:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d86c24cb3a0) 00000020:00000080:2.0:1787847481.115564:0:14376:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787847481.115569:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787847481.115623:0:14376:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787847481.115630:0:14376:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787847481.115636:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1835de88b9862c20 00000100:00100000:0.0:1787847481.115693:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616392704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787847481.115744:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874693616392704 offset 0 length 520: 4 00010000:00080000:2.0:1787847481.115992:0:14376:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d87c32f7000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1787847481.116198:0:14376:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787847481.116387:0:14376:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787847481.116408:0:14376:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787847481.118627:0:14376:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847481.120159:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787847481.120264:0:14376:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787847481.122355:0:14382:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787847481.122372:0:14382:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787847481.133391:0:14376:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787847481.133407:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787847481.133445:0:14376:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787847481.133464:0:14376:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9862c27 00000100:00080000:0.0:1787847481.133475:0:14376:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787847481.133482:0:14376:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d87c32f7000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847481.133516:0:14376:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d86c1dbe940 x1874693616392832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847481.133586:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616392832:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787847481.133638:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874693616392832 offset 0 length 520: 4 00000100:00080000:0.0:1787847481.133767:0:14376:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787847481.133983:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847481.133988:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.133990:0:14376:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787847481.133993:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847481.133997:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.133998:0:14376:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787847481.134001:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787847481.134002:0:14376:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787847481.134012:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847481.134015:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.134016:0:14376:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787847481.134019:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847481.134021:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.134023:0:14376:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787847481.134026:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787847481.134057:0:14376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14376:1874693616392960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.134105:0:14376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847481.134130:0:14376:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbcc180 going to sleep for 11 seconds 00000100:00100000:3.0:1787847481.138216:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616392960 00000100:00100000:3.0:1787847481.138233:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616392960 00000100:00100000:3.0:1787847481.138314:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787847481.138325:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14376:x1874693616392960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787847481.138629:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14376:x1874693616392960:12345-0@lo:502:llog_process_th.0 Request processed in 306us (4523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847481.138637:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787847481.138994:0:14376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14376:1874693616392960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847481.139031:0:14376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847481.139039:0:14376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.139041:0:14376:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787847481.139046:0:14376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787847481.139223:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787847481.139244:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787847481.139267:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.139278:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4c00/0x1835de88b9862bb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862bb7 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847481.139285:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87e6e62000 from 1 10000000:01000000:3.0:1787847481.139288:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787847481.139319:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.139327:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.139346:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847481.139366:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393088:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847481.139402:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.139426:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847481.139489:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393088 00000100:00100000:0.0:1787847481.139493:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393088 00000100:00100000:0.0:1787847481.139527:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787847481.139535:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+9:14341:x1874693616393088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787847481.139543:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847481.139556:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862c2e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.139576:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862c2e expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.139586:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c2e expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.139595:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afee00, rc 0) 00000100:00100000:0.0:1787847481.139632:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+10:14341:x1874693616393088:12345-0@lo:101:mount.lustre.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.139638:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787847481.139983:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393088:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847481.139997:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.140006:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847481.140493:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393216:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787847481.140532:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.140553:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1787847481.140573:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393216 00000100:00100000:3.0:1787847481.140577:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393216 00000100:00100000:3.0:1787847481.140609:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787847481.140616:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+10:14341:x1874693616393216:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787847481.140630:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787847481.140636:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787847481.140881:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+10:14341:x1874693616393216:12345-0@lo:256:mount.lustre.0 Request processed in 265us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847481.140889:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787847481.140922:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393216:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787847481.141478:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787847481.141496:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.141506:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847481.141513:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87e6e62000 from 1 10000000:01000000:3.0:1787847481.141516:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787847481.141540:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.141548:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.141556:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847481.141570:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847481.141596:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.141611:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.141951:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393344 00000100:00100000:2.0:1787847481.141964:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393344 00000100:00100000:2.0:1787847481.142005:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787847481.142013:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+10:14341:x1874693616393344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847481.142035:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847481.142047:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862c3c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.142065:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862c3c expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.142075:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c3c expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.142082:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152b400, rc 0) 00000100:00100000:2.0:1787847481.142111:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616393344:12345-0@lo:101:mount.lustre.0 Request processed in 99us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.142116:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787847481.142488:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847481.142500:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847481.142509:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847481.142554:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847481.142583:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.142644:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.145707:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393472 00000100:00100000:2.0:1787847481.145722:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393472 00000100:00100000:0.0:1787847481.145911:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787847481.145923:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616393472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787847481.146388:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616393472:12345-0@lo:501:mount.lustre.0 Request processed in 465us (3801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.146396:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787847481.146571:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847481.146621:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787847481.146677:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847481.146714:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847481.147211:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393600 00000100:00100000:0.0:1787847481.147218:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393600 00000100:00100000:0.0:1787847481.147247:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787847481.147255:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616393600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787847481.147403:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616393600:12345-0@lo:503:mount.lustre.0 Request processed in 148us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.147411:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787847481.147603:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787847481.150872:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14384:1874693616393728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.151141:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847481.151221:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d89c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787847481.152551:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393728 00000100:00100000:1.0:1787847481.152563:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393728 00000100:00100000:1.0:1787847481.152616:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787847481.152626:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14384:x1874693616393728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787847481.152963:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14384:x1874693616393728:12345-0@lo:502:llog_process_th.0 Request processed in 330us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847481.152972:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787847481.153171:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14384:1874693616393728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847481.153205:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847481.153214:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.153217:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787847481.153225:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87e6e62000 00000020:00000080:0.0:1787847481.153227:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847481.153236:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847481.153239:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.153240:0:14384:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787847481.153250:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847481.153253:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.153254:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787847481.153258:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87e6e62000 00000020:00000080:0.0:1787847481.153260:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847481.153314:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847481.153317:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.153318:0:14384:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787847481.153321:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847481.153323:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.153324:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787847481.153328:0:14384:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d87e6e62000 00000020:00000080:0.0:1787847481.153330:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787847481.153376:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14384:1874693616393856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.153422:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847481.153463:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.153561:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393856 00000100:00100000:2.0:1787847481.153566:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393856 00000100:00100000:2.0:1787847481.153598:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787847481.153606:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14384:x1874693616393856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847481.153760:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14384:x1874693616393856:12345-0@lo:502:llog_process_th.0 Request processed in 155us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.153768:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787847481.153909:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14384:1874693616393856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787847481.153929:0:14384:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847481.153979:0:14384:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847481.153981:0:14384:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787847481.153985:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787847481.154147:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787847481.154166:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787847481.154186:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154196:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847481.154244:0:14341:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787847481.154247:0:14341:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d87e6e62000 10000000:01000000:2.0:1787847481.154250:0:14341:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d87e6e62000 10000000:01000000:2.0:1787847481.154254:0:14341:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787847481.154259:0:14341:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87e6e62000 from 1 10000000:01000000:2.0:1787847481.154262:0:14341:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787847481.154285:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154293:0:14341:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154301:0:14341:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847481.154315:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787847481.154344:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847481.154366:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.154379:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616393984 00000100:00100000:2.0:1787847481.154383:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616393984 00000100:00100000:2.0:1787847481.154404:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787847481.154410:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616393984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847481.154418:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847481.154430:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152ae00/0x1835de88b9862c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862c4a expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154449:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152ae00/0x1835de88b9862c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862c4a expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154472:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152ae00/0x1835de88b9862c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c4a expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154481:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ae00, rc 0) 00000100:00100000:2.0:1787847481.154510:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14341:x1874693616393984:12345-0@lo:101:mount.lustre.0 Request processed in 100us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.154516:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787847481.154548:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616393984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847481.154559:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c51 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.154568:0:14341:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862c51 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847481.154609:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616394112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847481.154633:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847481.154646:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.154657:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394112 00000100:00100000:2.0:1787847481.154731:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394112 00000100:00100000:2.0:1787847481.154756:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787847481.154763:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14341:x1874693616394112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847481.155002:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14341:x1874693616394112:12345-0@lo:501:mount.lustre.0 Request processed in 239us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.155009:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787847481.155039:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616394112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847481.155073:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616394240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847481.155105:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847481.155119:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.155131:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394240 00000100:00100000:2.0:1787847481.155135:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394240 00000100:00100000:2.0:1787847481.155155:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787847481.155160:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14341:x1874693616394240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847481.155289:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14341:x1874693616394240:12345-0@lo:503:mount.lustre.0 Request processed in 128us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.155296:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787847481.155333:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616394240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787847481.155586:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14385:1874693616394368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.155619:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847481.155638:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394368 00000100:00100000:0.0:1787847481.155642:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394368 00000100:00100000:0.0:1787847481.155677:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787847481.155684:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14385:x1874693616394368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.155824:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14385:x1874693616394368:12345-0@lo:502:llog_process_th.0 Request processed in 141us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.155839:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787847481.155874:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787847481.155889:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14385:1874693616394368:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787847481.155963:0:14385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787847481.155976:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d86c18bb3a0) 00000020:00000080:0.0:1787847481.155994:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787847481.156060:0:14385:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87e6e62000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787847481.156065:0:14385:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87e6e62000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787847481.156067:0:14385:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87e6e62000 4 00010000:00080000:0.0:1787847481.156099:0:14385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d87d056e800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.121@tcp at head 00010000:00010000:0.0:1787847481.157727:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787847481.157906:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787847481.157976:0:14385:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787847481.157988:0:14385:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1835de88b9862c5f 00000100:00080000:0.0:1787847481.157998:0:14385:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787847481.158004:0:14385:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d87d056e800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847481.158035:0:14385:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d86c1dbed00 x1874693616394496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787847481.158081:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616394496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787847481.158148:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787847481.158194:0:14385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787847481.158544:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394496 00000100:00100000:1.0:1787847481.158551:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394496 00000100:00100000:1.0:1787847481.158586:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847481.158593:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616394496:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787847481.158650:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616394496:12345-0@lo:38:llog_process_th.0 Request processed in 56us (501us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787847481.158656:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847481.175253:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787847481.175268:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87d056e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847481.175275:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787847481.175280:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616394496:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787847481.175828:0:14385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14385:1874693616394624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787847481.175914:0:14385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847481.175968:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394624 00000100:00100000:2.0:1787847481.175975:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394624 00000100:00100000:0.0:1787847481.175976:0:14385:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87de9cd540 going to sleep for 11 seconds 00000100:00100000:2.0:1787847481.176026:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787847481.176035:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14385:x1874693616394624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787847481.176302:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14385:x1874693616394624:12345-0@lo:502:llog_process_th.0 Request processed in 267us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847481.176312:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787847481.176344:0:14385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1d674ef9-f2fc-448e-8206-e13ebe069dba:14385:1874693616394624:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787847481.176438:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787847481.177065:0:14341:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787847481.177093:0:14341:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787847481.177115:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c51 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847481.177126:0:14341:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152aa00/0x1835de88b9862c4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c51 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787847481.177181:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787847481.177183:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787847481.177185:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847481.177186:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847481.177188:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847481.177189:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847481.177190:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787847481.177192:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787847481.177193:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847481.177195:0:14341:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847481.177198:0:14341:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787847481.177201:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787847481.177202:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787847481.177204:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847481.177205:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847481.177206:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847481.177207:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847481.177208:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787847481.177209:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787847481.177210:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847481.177211:0:14341:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847481.177227:0:14341:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787847481.177241:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616394752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787847481.177298:0:14341:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847481.177333:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847481.177646:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394752 00000100:00100000:3.0:1787847481.177653:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394752 00000100:00100000:3.0:1787847481.177702:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787847481.177711:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14341:x1874693616394752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787847481.177734:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787847481.177748:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787847481.263161:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787847481.263181:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787847481.265569:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787847481.265579:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787847481.265609:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.265628:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c2e expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.265637:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.265694:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862c2e expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.265711:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862c2e expref: 12 pid: 14352 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.265727:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1874693616394880:0@lo:104: 00000100:00100000:1.0:1787847481.265791:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847481.265845:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787847481.266009:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616394880 00000100:00100000:0.0:1787847481.266016:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616394880 00000100:00100000:0.0:1787847481.266064:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847481.266074:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14374:x1874693616394880:12345-0@lo:104: 00010000:00010000:0.0:1787847481.266087:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266140:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787847481.266146:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14374:x1874693616394880:12345-0@lo:104: Request processed in 75us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.266152:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787847481.266172:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847481.266178:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266184:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7c00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1787847481.266188:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266196:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847481.266202:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847481.266218:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787847481.266245:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266251:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847481.266270:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266278:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862c2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c35 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266292:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847481.266294:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847481.266296:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847481.266323:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616395008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787847481.266350:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847481.266406:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395008 00000100:00100000:0.0:1787847481.266410:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395008 00010000:00010000:0.0:1787847481.266425:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c2e expref: 13 pid: 14352 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847481.266443:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847481.266449:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+13:3301:x1874693616395008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847481.266458:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847481.266463:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c2e expref: 13 pid: 14352 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266472:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862c2e expref: 13 pid: 14352 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266495:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266502:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787847481.266514:0:14344:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000935890s 00010000:00010000:0.0:1787847481.266518:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266525:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266532:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266538:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266543:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847481.266547:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266553:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266561:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847481.266570:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847481.266598:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+13:3301:x1874693616395008:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847481.266610:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847481.266643:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616395008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787847481.266987:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6afee00/0x1835de88b9862c35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862c2e expref: 12 pid: 14352 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.267001:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1874693616394880:0@lo:104: 00010000:00010000:1.0:1787847481.267017:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.267025:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.267031:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847481.267043:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c14f4400/0x1835de88b9862c66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847481.291528:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14341:x1874693616394752:12345-0@lo:253:mount.lustre.0 Request processed in 113806us (114218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847481.291544:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787847481.293617:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:14341:1874693616394752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787847481.293641:0:14341:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787847481.293644:0:14341:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787847481.293646:0:14341:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787847481.293647:0:14341:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787847481.293648:0:14341:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787847481.293650:0:14341:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787847481.293651:0:14341:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787847481.293652:0:14341:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787847481.293654:0:14341:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787847481.293656:0:14341:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787847481.293658:0:14341:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787847481.293675:0:14341:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787847481.306730:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847481.306905:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787847481.307208:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847481.307358:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787847481.307633:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847481.307779:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787847481.315621:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847481.315787:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787847481.316435:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847481.316674:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787847481.319312:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787847481.319517:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787847481.376493:0:14341:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787847481.377213:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787847481.380132:0:14398:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787847481.380244:0:14398:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787847481.382625:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787847481.382716:0:14398:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787847481.382721:0:14398:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787847481.390379:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787847481.390522:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787847481.390665:0:14397:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787847481.390671:0:14397:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:2.0:1787847481.395593:0:14341:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787847481.395621:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787847481.396052:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847481.399327:0:14341:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787847481.401598:0:14341:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787847481.401885:0:14341:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787847481.406086:0:14341:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787847481.416782:0:14341:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787847481.524725:0:14341:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787847481.524764:0:14341:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4f1c1683988 00100000:10000000:3.0:1787847481.524773:0:14341:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787847481.530922:0:14341:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787847481.530984:0:14341:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787847481.531004:0:14341:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787847481.531025:0:14341:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787847481.943228:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787847482.266925:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787847482.711826:0:14356:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787847482.711835:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87e6e62000 from 6 10000000:01000000:1.0:1787847482.711840:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787847482.711889:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847482.711912:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847482.711922:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847482.711976:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616395136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787847482.712447:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847482.712514:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97540 going to sleep for 11 seconds 00000100:00100000:0.0:1787847482.712638:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395136 00000100:00100000:0.0:1787847482.712647:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395136 00000100:00100000:0.0:1787847482.712709:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787847482.712731:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14356:x1874693616395136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847482.712746:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847482.712761:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862c6d expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847482.712784:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862c6d expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847482.712794:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c6d expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847482.712803:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff600, rc 0) 00000100:00100000:0.0:1787847482.712863:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616395136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847482.712870:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787847482.714968:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616395136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847482.715087:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847482.715100:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847482.715170:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616395264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787847482.715225:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847482.715265:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97540 going to sleep for 11 seconds 00000100:00100000:0.0:1787847482.715446:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395264 00000100:00100000:0.0:1787847482.715452:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395264 00000100:00100000:0.0:1787847482.715499:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787847482.715507:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616395264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787847482.715525:0:14352:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787847482.715539:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787847482.715542:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787847482.715617:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616395264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847482.715625:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787847482.715657:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616395264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787847482.715705:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787847482.715711:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847482.715827:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847482.967256:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787847483.290707:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787847483.992792:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847485.015960:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847486.039955:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787847486.301143:0:14641:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787847486.551876:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787847486.551892:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787847486.551895:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787847486.551898:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787847486.551901:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787847486.551904:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787847486.551907:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d87d056e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787847486.551920:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d87d056e800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847486.551959:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d8800369e00 x1874693616395520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787847486.552012:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616395392:0@lo:400:kworker.0 00000100:00100000:2.0:1787847486.553122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847486.554801:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616395520:0@lo:38:kworker.0 00000100:00100000:0.0:1787847486.554871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847486.555070:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395520 00000100:00100000:3.0:1787847486.555079:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395520 00000100:00100000:3.0:1787847486.555109:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847486.555117:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1874693616395520:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787847486.555143:0:14360:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:3.0:1787847486.555176:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1835de88b9862c7b 00000004:00100000:3.0:1787847486.555191:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787847486.555318:0:14360:0:(import.c:65:import_set_state_nolock()) ffff8d87c9356800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787847486.555381:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1874693616395520:12345-0@lo:38:kworker.0 Request processed in 264us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847486.555388:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787847486.556067:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d8800369e00 x1874693616395520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787847496 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787847486.556084:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787847486.556091:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787847486.556095:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787847486.556098:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87d056e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787847486.556104:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1874693616395520:0@lo:38:kworker.0 00000100:00100000:1.0:1787847486.557010:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395392 00000100:00100000:1.0:1787847486.557019:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395392 00000100:00100000:1.0:1787847486.557208:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787847486.557218:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:3302:x1874693616395392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847486.557294:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:3302:x1874693616395392:12345-0@lo:400:kworker.0 Request processed in 77us (4176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847486.557301:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787847486.557580:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616395392:0@lo:400:kworker.0 00010000:00010000:0.0:1787847487.064091:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847488.088125:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847489.113558:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787847489.841912:0:14791:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc85a6caa0 20000000:00000080:0.0:1787847489.842141:0:14791:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d8801873800 uarg=0000000000000000 20000000:01000000:0.0:1787847489.842180:0:14791:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787847489.842187:0:14791:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787847489.842192:0:14791:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787847489.843082:0:14792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787847489.843242:0:14791:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787847489.849442:0:14791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787847489.849473:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847489.849492:0:14791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c3c expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847489.849500:0:14791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847489.849544:0:14791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862c3c expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847489.849560:0:14791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862c3c expref: 11 pid: 14352 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847489.849575:0:14791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1874693616395648:0@lo:104: 00000100:00100000:0.0:1787847489.849759:0:14791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847489.849875:0:14791:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847489.850135:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395648 00000100:00100000:2.0:1787847489.850142:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395648 00000100:00100000:2.0:1787847489.850190:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847489.850199:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14791:x1874693616395648:12345-0@lo:104: 00010000:00010000:2.0:1787847489.850302:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847489.850440:0:14791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14791:1874693616395648:0@lo:104: 00010000:00010000:0.0:1787847489.850461:0:14791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847489.850493:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787847489.850499:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14791:x1874693616395648:12345-0@lo:104: Request processed in 302us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847489.850507:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787847489.850614:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847489.850622:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.850629:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847489.850632:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.850648:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847489.850655:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847489.850660:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787847489.850789:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.850795:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847489.850833:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.850841:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862c3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c43 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.850858:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847489.850860:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847489.850862:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847489.850870:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787847489.850881:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616395776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847489.850916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847489.850993:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395776 00000100:00100000:3.0:1787847489.850997:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395776 00010000:00010000:3.0:1787847489.851016:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c3c expref: 12 pid: 14352 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847489.851036:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847489.851042:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:3302:x1874693616395776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847489.851051:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847489.851056:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c3c expref: 12 pid: 14352 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851065:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862c3c expref: 12 pid: 14352 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851078:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87f152b400/0x1835de88b9862c43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862c3c expref: 12 pid: 14352 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851096:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851104:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851115:0:14344:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851121:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851128:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851134:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851139:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847489.851143:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.851150:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.852404:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847489.852420:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847489.852475:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ade00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:3302:x1874693616395776:12345-0@lo:103:ldlm_bl.0 Request processed in 1431us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847489.852493:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787847489.852580:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616395776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847489.852633:0:14791:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847489.852762:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847489.852768:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6aff400/0x1835de88b9862c82 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847490.135450:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787847490.906458:0:14356:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787847490.906472:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87e6e62000 from 10 10000000:01000000:0.0:1787847490.906705:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787847490.906775:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847490.906823:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847490.906837:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847490.906875:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616395904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787847490.907010:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847490.907086:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87efbcccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847490.907110:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616395904 00000100:00100000:3.0:1787847490.907120:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616395904 00000100:00100000:3.0:1787847490.907204:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787847490.907216:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+11:14356:x1874693616395904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847490.907235:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847490.907255:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862c89 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847490.907287:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862c89 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847490.907301:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c89 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847490.907323:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847490.907385:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616395904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847490.907393:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787847490.907521:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616395904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847490.907540:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847490.907550:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847490.907631:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616396032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847490.907664:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847490.907689:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787847490.907705:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616396032 00000100:00100000:2.0:1787847490.907709:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616396032 00000100:00100000:2.0:1787847490.907735:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847490.907741:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616396032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847490.908063:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616396032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847490.908072:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787847490.908101:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616396032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847490.908134:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616396160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847490.908179:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847490.908191:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddf180 going to sleep for 11 seconds 00000100:00100000:2.0:1787847490.908201:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616396160 00000100:00100000:2.0:1787847490.908204:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616396160 00000100:00100000:2.0:1787847490.908221:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787847490.908226:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616396160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847490.908377:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:14356:x1874693616396160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847490.908384:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787847490.908420:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616396160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787847490.912666:0:14829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787847490.912815:0:14356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787847490.912847:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787847490.912862:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847490.912875:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847491.160563:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847491.672014:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787847481/real 1787847481] req@ffff8d86c1dbe940 x1874693616392832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847491 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847491.672055:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d86c1dbe940 x1874693616392832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847491 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847491.672066:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787847481/real 1787847481] req@ffff8d880036a940 x1874693616392704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847491 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847491.672085:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d880036a940 x1874693616392704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847491 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787847491.672108:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787847491.672137:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787847491.672159:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616392832:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787847491.672167:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d8800360800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787847491.672173:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787847491.672176:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616392704:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787847491.672323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787847491.672329:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787847491.672333:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d8800360800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787847491.672339:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1787847491.672346:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787847491.672354:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d8800360800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847491.672388:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d86c1dbc780 x1874693616396416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787847491.672401:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787847491.672404:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787847491.672406:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787847491.672410:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1787847491.672412:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787847491.672417:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d87c32f7000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847491.672429:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d86c1dbf0c0 x1874693616396544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787847491.672469:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616396672:0@lo:400:kworker.0 00000100:00100000:0.0:1787847491.672559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847491.672642:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787847491.672650:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616396288:0@lo:400:kworker.0 00000100:00100000:0.0:1787847491.672683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847491.672740:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616396672 00000100:00100000:0.0:1787847491.672748:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616396672 00000100:00100000:0.0:1787847491.672815:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847491.672826:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616396672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847491.672884:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616396672:12345-0@lo:400:kworker.0 Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847491.672891:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847491.672917:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616396288 00000100:00100000:0.0:1787847491.672921:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616396288 00000100:00100000:0.0:1787847491.672984:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787847491.672991:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:3301:x1874693616396288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847491.673034:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:3301:x1874693616396288:12345-0@lo:400:kworker.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847491.673040:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787847491.673109:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616396288:0@lo:400:kworker.0 00010000:00080000:0.0:1787847491.673123:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d86c1dbe580 x1874693616396672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847491.673134:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616396672:0@lo:400:kworker.0 00000100:00100000:1.0:1787847491.673381:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616396416:0@lo:8:kworker.0 00000400:00000100:1.0:1787847491.673418:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874693616396416 offset 0 length 520: 4 00000100:00100000:1.0:1787847491.673439:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616396544:0@lo:8:kworker.0 00000400:00000100:1.0:1787847491.673461:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874693616396544 offset 0 length 520: 4 00010000:00010000:2.0:1787847492.187732:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847493.207260:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787847493.530757:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787847494.231547:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847495.255374:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787847495.799510:0:15041:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787847495.799515:0:15041:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787847495.799674:0:15041:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d87c72c8000 00000020:01000004:2.0:1787847495.799692:0:15041:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787847495.799716:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787847495.799730:0:15041:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d87c60919d0) 00000020:00000080:2.0:1787847495.800191:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787847495.818423:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787847495.818672:0:15041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787847495.819688:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787847495.819920:0:15041:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787847495.820564:0:15041:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787847495.821178:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:1.0:1787847495.821272:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:1.0:1787847495.821357:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:1.0:1787847495.821788:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 605: rc = 0 00100000:10000000:1.0:1787847495.822215:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 605: rc = 0 00100000:10000000:1.0:1787847495.824178:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 605: rc = 0 00100000:10000000:1.0:1787847495.824475:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 605: rc = 0 00100000:10000000:1.0:1787847495.824876:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 605: rc = 0 00100000:10000000:1.0:1787847495.825227:0:15041:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 605: rc = 0 00000020:00000080:1.0:1787847495.825844:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787847495.825854:0:15041:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787847495.825863:0:15041:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1835de88b9862c9e 00000020:01000004:1.0:1787847495.825870:0:15041:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787847495.825890:0:15041:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787847495.825893:0:15041:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787847495.825906:0:15041:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787847495.825911:0:15041:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787847495.825922:0:15041:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d87c7c033a0) 00000020:00000080:1.0:1787847495.825955:0:15041:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1787847495.827105:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787847495.827685:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787847495.827690:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787847495.828577:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787847495.828659:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787847495.829278:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787847495.829285:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787847495.837514:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847495.837713:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787847495.837720:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787847495.838366:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787847495.838374:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787847495.853861:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787847495.854384:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787847495.854391:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787847495.856722:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787847495.856737:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787847495.858728:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787847495.858742:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787847495.861446:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787847495.864368:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787847495.864381:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787847495.865411:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787847495.865420:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787847495.899061:0:15041:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787847495.899392:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787847495.899399:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787847495.900568:0:15041:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787847495.900579:0:15041:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787847495.901077:0:15041:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787847495.901116:0:15041:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787847495.901122:0:15041:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787847495.913063:0:15041:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787847495.913273:0:15041:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.121@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787847495.913278:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787847495.913280:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787847495.913282:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847495.913283:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847495.913284:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847495.913285:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847495.913287:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787847495.913289:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847495.913290:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787847495.913293:0:15041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787847495.913295:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787847495.913296:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787847495.913298:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847495.913299:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847495.913300:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847495.913301:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847495.913302:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787847495.913303:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847495.913304:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787847495.913329:0:15041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787847495.913348:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616396800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787847495.913744:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.914169:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e000 going to sleep for 11 seconds 00000100:00100000:0.0:1787847495.916479:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616396800 00000100:00100000:0.0:1787847495.916493:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616396800 00000100:00100000:0.0:1787847495.916600:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787847495.916610:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:15041:x1874693616396800:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787847495.916645:0:14351:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787847495.916648:0:14351:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787847495.916652:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1787847495.920383:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:15041:x1874693616396800:12345-0@lo:253:mount.lustre.0 Request processed in 3767us (6631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.920396:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787847495.920474:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616396800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787847495.920500:0:15041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787847495.920503:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787847495.920504:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787847495.920505:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787847495.920506:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787847495.920507:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787847495.920508:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787847495.920509:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787847495.920510:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787847495.920511:0:15041:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787847495.920527:0:15041:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d87c72c8000 from lustre-OST0000 10000000:01000000:3.0:1787847495.920551:0:15041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787847495.920552:0:15041:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787847495.920558:0:15041:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d86c18b8000 local copy 00010000:00010000:3.0:1787847495.920567:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847495.920776:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616396928:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847495.920809:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.921273:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847495.921348:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616396928 00000100:00100000:2.0:1787847495.921354:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616396928 00000100:00100000:2.0:1787847495.921386:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787847495.921393:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:15041:x1874693616396928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847495.921528:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:15041:x1874693616396928:12345-0@lo:501:mount.lustre.0 Request processed in 134us (717us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787847495.921540:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787847495.921613:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616396928:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787847495.921625:0:15041:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787847495.921769:0:15041:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787847495.921776:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.921783:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847495.921800:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d87c72c8000 10000000:01000000:3.0:1787847495.921806:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787847495.921810:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d86c18b8000 10000000:01000000:3.0:1787847495.921812:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787847495.921814:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d86c18b8000 from 1 10000000:01000000:3.0:1787847495.921817:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787847495.921837:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.921842:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.921849:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847495.921859:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847495.922000:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.922018:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847495.922061:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397056 00000100:00100000:2.0:1787847495.922064:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397056 00000100:00100000:2.0:1787847495.922078:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787847495.922081:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+12:15041:x1874693616397056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847495.922088:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847495.922106:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152a400/0x1835de88b9862cb3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862cac expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.922125:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152a400/0x1835de88b9862cb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862cac expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.922133:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152a400/0x1835de88b9862cb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862cac expref: 13 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.922140:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152a400, rc 0) 00000100:00100000:2.0:1787847495.922164:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+13:15041:x1874693616397056:12345-0@lo:101:mount.lustre.0 Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847495.922168:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787847495.922264:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847495.922272:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cb3 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.922278:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862cb3 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847495.922289:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787847495.922304:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cb3 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.922308:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6400/0x1835de88b9862cac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cb3 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847495.922321:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787847495.922323:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787847495.922326:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787847495.922327:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787847495.922337:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.922341:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.922345:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847495.922352:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847495.922370:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.922377:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847495.922475:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397184 00000100:00100000:2.0:1787847495.922478:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397184 00000100:00100000:2.0:1787847495.922490:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787847495.922494:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+13:15041:x1874693616397184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847495.922498:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847495.922504:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87f152ac00/0x1835de88b9862cc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862cba expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.922512:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87f152ac00/0x1835de88b9862cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862cba expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.922522:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87f152ac00/0x1835de88b9862cc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862cba expref: 14 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.922527:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87f152ac00, rc 0) 00000100:00100000:2.0:1787847495.922552:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397184:12345-0@lo:101:mount.lustre.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847495.922556:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787847495.922653:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847495.922662:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cc1 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847495.922670:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862cc1 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787847495.923171:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787847495.923964:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847495.924184:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787847495.924213:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787847495.924230:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787847495.924265:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787847495.924297:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787847495.924315:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787847495.924359:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787847495.924365:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787847495.924419:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847495.924465:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.924498:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787847495.924591:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397312 00000100:00100000:2.0:1787847495.924595:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397312 00000100:00100000:2.0:1787847495.924620:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787847495.924625:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397312:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847495.924876:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397312:12345-0@lo:501:mount.lustre.0 Request processed in 250us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847495.924889:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787847495.925080:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847495.925156:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787847495.925184:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.925197:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.925240:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397440 00000100:00100000:1.0:1787847495.925243:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397440 00000100:00100000:1.0:1787847495.925262:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787847495.925266:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787847495.925484:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397440:12345-0@lo:503:mount.lustre.0 Request processed in 217us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.925489:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787847495.925547:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787847495.926512:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787847495.926564:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787847495.926610:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.926655:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.926657:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397568 00000100:00100000:1.0:1787847495.926662:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397568 00000100:00100000:1.0:1787847495.926707:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787847495.926716:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847495.926987:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397568:12345-0@lo:502:mount.lustre.0 Request processed in 272us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.927001:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787847495.927031:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397568:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787847495.927220:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787847495.927249:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787847495.927265:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787847495.927288:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787847495.927306:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787847495.927322:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787847495.927392:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787847495.927415:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787847495.927431:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787847495.927469:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787847495.927498:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787847495.927524:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787847495.927542:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787847495.927568:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847495.927604:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787847495.927617:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397696 00000100:00100000:2.0:1787847495.927621:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397696 00000100:00100000:2.0:1787847495.927659:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787847495.927667:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847495.928225:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397696:12345-0@lo:502:mount.lustre.0 Request processed in 557us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847495.928232:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787847495.931093:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787847495.931242:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787847495.931258:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787847495.938232:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787847495.938243:0:15055:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787847495.938248:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787847495.938250:0:15055:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787847495.938256:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787847495.938272:0:15055:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d88018819d0) 00000020:00000080:3.0:1787847495.938294:0:15055:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787847495.938300:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787847495.938366:0:15055:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87c72c8000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787847495.938372:0:15055:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787847495.938379:0:15055:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1835de88b9862ccf 00010000:00010000:3.0:1787847495.941328:0:15055:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787847495.941874:0:15055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787847495.945552:0:15055:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787847495.948628:0:15055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787847495.948642:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847495.948651:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847495.948654:0:15055:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787847495.948667:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787847495.948670:0:15055:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1787847495.948672:0:15055:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787847495.948674:0:15055:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787847495.948675:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787847495.948678:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847495.948679:0:15055:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787847495.948681:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847495.948684:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847495.948686:0:15055:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787847495.948689:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787847495.948691:0:15055:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787847495.948701:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847495.948704:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847495.948706:0:15055:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787847495.948709:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847495.948711:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847495.948713:0:15055:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787847495.948717:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787847495.948804:0:15055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847495.948808:0:15055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847495.948810:0:15055:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787847495.948813:0:15055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787847495.949174:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787847495.949215:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787847495.949239:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cc1 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847495.949251:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7600/0x1835de88b9862cba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cc1 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847495.949271:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87c72c8000 from 1 10000000:01000000:0.0:1787847495.949274:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787847495.949316:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847495.949325:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847495.949340:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847495.949369:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397824:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787847495.949457:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847495.949494:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7000 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.950061:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397824 00000100:00100000:1.0:1787847495.950070:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397824 00000100:00100000:1.0:1787847495.950273:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787847495.950284:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+14:15041:x1874693616397824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787847495.950298:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847495.950313:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862cd6 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847495.950339:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 15 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847495.950350:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 15 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847495.950358:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c14f5c00, rc 0) 00000100:00100000:1.0:1787847495.950418:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616397824:12345-0@lo:101:mount.lustre.0 Request processed in 137us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.950425:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787847495.951027:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbe580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847495.951049:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.951059:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847495.953999:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787847495.956425:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847495.956759:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787847495.956810:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787847495.956867:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787847495.956875:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787847495.957080:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847495.957240:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.957327:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847495.957368:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616397952 00000100:00100000:3.0:1787847495.957374:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616397952 00000100:00100000:3.0:1787847495.957452:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787847495.957460:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616397952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847495.957659:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616397952:12345-0@lo:501:mount.lustre.0 Request processed in 199us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847495.957666:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787847495.957752:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616397952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847495.957780:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847495.957814:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.957873:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.958046:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398080 00000100:00100000:1.0:1787847495.958051:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398080 00000100:00100000:1.0:1787847495.958071:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787847495.958077:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398080:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787847495.958219:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398080:12345-0@lo:503:mount.lustre.0 Request processed in 141us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.958225:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787847495.958393:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398080:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787847495.958813:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787847495.958873:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847495.961897:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.961957:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.962139:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398208 00000100:00100000:1.0:1787847495.962156:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398208 00000100:00100000:1.0:1787847495.962218:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787847495.962228:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847495.962457:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398208:12345-0@lo:502:mount.lustre.0 Request processed in 230us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.962463:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787847495.962580:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787847495.962871:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787847495.962920:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787847495.963098:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787847495.963134:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787847495.963163:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787847495.963200:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787847495.963230:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787847495.963257:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787847495.963292:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787847495.963335:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847495.963402:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d88008c7900 going to sleep for 11 seconds 00000100:00100000:3.0:1787847495.963435:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398336 00000100:00100000:3.0:1787847495.963440:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398336 00000100:00100000:3.0:1787847495.963500:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787847495.963509:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787847495.963656:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398336:12345-0@lo:502:mount.lustre.0 Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847495.963664:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787847495.963736:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787847495.963814:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787847495.963822:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787847495.965195:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847495.965205:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847495.965208:0:15059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787847495.965214:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87c72c8000 00000020:00000080:0.0:1787847495.965216:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847495.965223:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847495.965225:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847495.965227:0:15059:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787847495.965230:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847495.965232:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847495.965234:0:15059:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787847495.965237:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d87c72c8000 00000020:00000080:0.0:1787847495.965239:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847495.965331:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847495.965335:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847495.965336:0:15059:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787847495.965339:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847495.965341:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847495.965343:0:15059:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787847495.965346:0:15059:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d87c72c8000 00000020:00000080:0.0:1787847495.965348:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847495.966410:0:15059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847495.966418:0:15059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847495.966420:0:15059:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787847495.966423:0:15059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787847495.966574:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787847495.966600:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787847495.966617:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.966628:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847495.966678:0:15041:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787847495.966681:0:15041:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d87c72c8000 10000000:01000000:2.0:1787847495.966683:0:15041:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d87c72c8000 10000000:01000000:2.0:1787847495.966688:0:15041:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787847495.966717:0:15041:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d87c72c8000 from 1 10000000:01000000:2.0:1787847495.966720:0:15041:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787847495.966763:0:15041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.966773:0:15041:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.966784:0:15041:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847495.966809:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787847495.966873:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.966922:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a78a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847495.967506:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398464 00000100:00100000:0.0:1787847495.967515:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398464 00000100:00100000:0.0:1787847495.967571:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787847495.967710:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616398464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787847495.967728:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847495.967752:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff200/0x1835de88b9862ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862ce4 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847495.967779:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff200/0x1835de88b9862ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862ce4 expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847495.967790:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff200/0x1835de88b9862ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862ce4 expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847495.967799:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff200, rc 0) 00000100:00100000:0.0:1787847495.967857:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398464:12345-0@lo:101:mount.lustre.0 Request processed in 277us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847495.967864:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787847495.967988:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847495.968003:0:15041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862ceb expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.968012:0:15041:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862ceb expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847495.968551:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787847495.968852:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847495.969191:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787847495.969234:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787847495.969268:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787847495.969315:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787847495.969349:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787847495.969395:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787847495.969429:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787847495.969470:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787847495.969514:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787847495.969548:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787847495.969577:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787847495.969618:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787847495.969650:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787847495.969966:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787847495.970017:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787847495.970052:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787847495.970083:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787847495.970127:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787847495.970159:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787847495.970190:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787847495.970232:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787847495.970266:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787847495.970297:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787847495.970340:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787847495.970373:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787847495.970406:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787847495.970450:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787847495.970484:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787847495.970555:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787847495.970562:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787847495.970659:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847495.970757:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.970801:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a78a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.971829:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398592 00000100:00100000:1.0:1787847495.971838:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398592 00000100:00100000:1.0:1787847495.971894:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787847495.971904:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787847495.972162:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398592:12345-0@lo:501:mount.lustre.0 Request processed in 259us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.972170:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787847495.972464:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847495.972507:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398720:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847495.972548:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.972612:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a78a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847495.974265:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398720 00000100:00100000:1.0:1787847495.974276:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398720 00000100:00100000:1.0:1787847495.974329:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787847495.974339:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787847495.974729:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398720:12345-0@lo:503:mount.lustre.0 Request processed in 390us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847495.974738:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787847495.974759:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398720:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787847495.975321:0:15041:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787847495.975390:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847495.975437:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.975469:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398848 00000100:00100000:2.0:1787847495.975474:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398848 00000100:00100000:2.0:1787847495.975502:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787847495.975511:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847495.975724:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398848:12345-0@lo:502:mount.lustre.0 Request processed in 214us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847495.975732:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787847495.975776:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a78a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787847495.975791:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787847495.976041:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787847495.976089:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787847495.976122:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787847495.976166:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787847495.976201:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787847495.976245:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787847495.976279:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787847495.976308:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787847495.976351:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787847495.976385:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787847495.976418:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787847495.977443:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787847495.977483:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787847495.977529:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787847495.977579:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787847495.977621:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787847495.977653:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787847495.977721:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787847495.977757:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787847495.977783:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787847495.977821:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787847495.977850:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787847495.977876:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787847495.977918:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787847495.977972:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787847495.978021:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787847495.978063:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787847495.978093:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787847495.978124:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787847495.978184:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787847495.978229:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787847495.978260:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1787847495.978287:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1787847495.978336:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1787847495.978368:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1787847495.978407:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1787847495.978438:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1787847495.978466:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1787847495.978509:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1787847495.979274:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1787847495.979324:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847495.979396:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.979471:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a78a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847495.979511:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616398976 00000100:00100000:0.0:1787847495.979518:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616398976 00000100:00100000:0.0:1787847495.979592:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787847495.979602:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787847495.979816:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616398976:12345-0@lo:502:mount.lustre.0 Request processed in 215us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847495.979823:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787847495.979888:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616398976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787847495.979969:0:15041:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1787847495.979977:0:15041:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787847495.982804:0:15064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787847495.982822:0:15064:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d86c18bcd70) 00000020:00000080:0.0:1787847495.982843:0:15064:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787847495.984504:0:15064:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d87c72c8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787847495.984512:0:15064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d87c72c8000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787847495.984515:0:15064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d87c72c8000 3 00010000:00080000:0.0:1787847495.984549:0:15064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d880075a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.121@tcp at head 00010000:00010000:0.0:1787847495.986425:0:15064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787847495.986688:0:15064:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787847495.986741:0:15064:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787847495.986753:0:15064:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1835de88b9862cf9 00000100:00080000:0.0:1787847495.986764:0:15064:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787847495.986770:0:15064:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d880075a800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:0.0:1787847495.986805:0:15064:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d86c1dbf480 x1874693616399104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787847495.986827:0:15064:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787847495.986851:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787847495.986856:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787847495.986859:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787847495.986862:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787847495.987431:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847495.987446:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616399232:0@lo:400:kworker.0 00000100:00100000:2.0:1787847495.987511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.987624:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399232 00000100:00100000:2.0:1787847495.987631:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399232 00000100:00100000:2.0:1787847495.987671:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847495.987680:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616399232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847495.987736:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616399232:12345-0@lo:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847495.987743:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787847495.987860:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d86c1dbf840 x1874693616399232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787847495.987875:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616399232:0@lo:400:kworker.0 00000100:00100000:0.0:1787847495.988027:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616399104:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787847495.988072:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787847495.988178:0:15064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787847495.988375:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399104 00000100:00100000:3.0:1787847495.988380:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399104 00000100:00100000:3.0:1787847495.988403:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787847495.988408:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1874693616399104:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787847495.988428:0:14360:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:3.0:1787847495.988484:0:14360:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1835de88b9862d00 00000004:00100000:3.0:1787847495.988499:0:14360:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787847495.988529:0:14360:0:(import.c:65:import_set_state_nolock()) ffff8d87c9352800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1787847495.988664:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d86c1dbf480 x1874693616399104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787847505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847495.988673:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787847495.988679:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787847495.988686:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787847495.988689:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787847495.988691:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d880075a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787847495.988707:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1874693616399104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787847495.988739:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1874693616399104:12345-0@lo:38:llog_process_th.0 Request processed in 171us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847495.988747:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000000:2.0:1787847495.988836:0:15041:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787847495.988953:0:15041:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787847495.988974:0:15041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862ceb expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847495.988984:0:15041:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152b400/0x1835de88b9862ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862ceb expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787847495.989033:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787847495.989036:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847495.989037:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847495.989039:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847495.989040:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847495.989041:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847495.989043:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847495.989044:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847495.989051:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847495.989055:0:15041:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787847495.989058:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787847495.989059:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847495.989060:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847495.989061:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847495.989062:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847495.989063:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847495.989065:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847495.989066:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847495.989067:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787847495.989081:0:15041:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787847495.989093:0:15041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616399360:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787847495.989195:0:15041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847495.989222:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399360 00000100:00100000:2.0:1787847495.989227:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399360 00000100:00100000:2.0:1787847495.989254:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787847495.989262:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15041:x1874693616399360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787847495.989280:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787847495.989293:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787847495.989736:0:15041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c6a78900 going to sleep for 11 seconds 20000000:01000000:1.0:1787847496.007751:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787847496.007772:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787847496.008092:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787847496.008096:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787847496.008117:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847496.008140:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c6d expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847496.008146:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847496.008176:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862c6d expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847496.008187:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862c6d expref: 16 pid: 14353 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847496.008198:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1874693616399488:0@lo:104: 00000100:00100000:0.0:1787847496.008250:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847496.008304:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c50fbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787847496.008412:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399488 00000100:00100000:2.0:1787847496.008419:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399488 00000100:00100000:2.0:1787847496.009834:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787847496.009849:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14374:x1874693616399488:12345-0@lo:104: 00010000:00010000:2.0:1787847496.009867:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847496.010130:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787847496.010138:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14374:x1874693616399488:12345-0@lo:104: Request processed in 293us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847496.010146:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847496.010168:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1874693616399488:0@lo:104: 00010000:00010000:1.0:1787847496.010191:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847496.010199:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847496.010206:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847496.010214:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847496.010218:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847496.010226:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847496.010244:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847496.010249:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847496.010321:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847496.010328:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847496.010347:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847496.010354:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c14f4400/0x1835de88b9862c6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c74 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847496.010413:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d674ef9-f2fc-448e-8206-e13ebe069dba:3303:1874693616399616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847496.010453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787847496.010503:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847496.010505:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847496.010507:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847496.010508:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399616 00000100:00100000:1.0:1787847496.010517:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399616 00010000:00010000:1.0:1787847496.010541:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c6d expref: 17 pid: 14353 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847496.010579:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847496.010587:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:3303:x1874693616399616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787847496.010597:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847496.010602:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c6d expref: 17 pid: 14353 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010613:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862c6d expref: 17 pid: 14353 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010627:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862c74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862c6d expref: 17 pid: 14353 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010639:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010647:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787847496.010660:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002563786s 00010000:00010000:1.0:1787847496.010665:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010671:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010677:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010691:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010708:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847496.010712:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010719:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010733:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010742:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847496.010771:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007afc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:3303:x1874693616399616:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847496.010779:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787847496.010797:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847496.010798:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d674ef9-f2fc-448e-8206-e13ebe069dba:3303:1874693616399616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787847496.010805:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847496.010811:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862d07 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847496.013460:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:15041:x1874693616399360:12345-0@lo:253:mount.lustre.0 Request processed in 24193us (24258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847496.013474:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787847496.013649:0:15041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15041:1874693616399360:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787847496.013661:0:15041:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787847496.013664:0:15041:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787847496.013665:0:15041:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787847496.013666:0:15041:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787847496.013667:0:15041:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787847496.013668:0:15041:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787847496.013669:0:15041:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787847496.013670:0:15041:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787847496.013671:0:15041:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787847496.013672:0:15041:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787847496.013704:0:15041:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787847496.016412:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847496.016517:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787847496.016648:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847496.016760:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787847496.016849:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787847496.017041:0:15041:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787847496.017594:0:15041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787847496.046986:0:15041:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787847496.046994:0:15041:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787847496.047027:0:15041:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787847496.047081:0:15041:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787847496.047093:0:15041:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787847496.047120:0:15041:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787847496.282990:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847497.303017:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787847497.431042:0:14356:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787847497.431051:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87e6e62000 from 7 10000000:01000000:2.0:1787847497.431056:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787847497.431108:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847497.431122:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847497.431132:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847497.431158:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616399744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787847497.431247:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847497.431300:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c505e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847497.431305:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399744 00000100:00100000:0.0:1787847497.431312:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399744 00000100:00100000:0.0:1787847497.431365:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787847497.431376:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+15:14356:x1874693616399744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847497.431389:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847497.431401:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862d0e expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847497.431422:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862d0e expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847497.431438:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862d0e expref: 16 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847497.431447:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff800, rc 0) 00000100:00100000:0.0:1787847497.431495:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:14356:x1874693616399744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847497.431501:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787847497.431577:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616399744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787847497.431591:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847497.431600:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847497.431654:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616399872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787847497.431698:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847497.431721:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f9c490c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847497.432582:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616399872 00000100:00100000:0.0:1787847497.432590:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616399872 00000100:00100000:0.0:1787847497.432633:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787847497.432641:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:14356:x1874693616399872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787847497.432658:0:14352:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787847497.432685:0:14352:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787847497.432689:0:14352:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787847497.432887:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616399872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787847497.438479:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787847497.438493:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847497.438504:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847497.438584:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:14356:x1874693616399872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 5938us (6879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847497.438595:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787847498.328586:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847499.352006:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847500.378735:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847501.399088:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787847501.402448:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787847501.402457:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787847501.402460:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787847501.402463:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787847501.402512:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616400128:0@lo:400:kworker.0 00000100:00100000:1.0:1787847501.402584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847501.402731:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847501.402739:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616400000:0@lo:400:kworker.0 00000100:00100000:1.0:1787847501.402774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847501.402811:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400128 00000100:00100000:1.0:1787847501.402818:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400128 00000100:00100000:1.0:1787847501.402998:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847501.403007:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616400128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847501.403061:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616400128:12345-0@lo:400:kworker.0 Request processed in 54us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847501.403068:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787847501.403108:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800515a40 x1874693616400128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847501.403178:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800515a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616400128:0@lo:400:kworker.0 00000100:00100000:3.0:1787847501.403339:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616400256:0@lo:400:kworker.0 00000100:00100000:3.0:1787847501.403376:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847501.403415:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400000 00000100:00100000:3.0:1787847501.403420:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400000 00000100:00100000:3.0:1787847501.403449:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787847501.403455:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:3301:x1874693616400000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847501.403492:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:3301:x1874693616400000:12345-0@lo:400:kworker.0 Request processed in 37us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847501.403498:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787847501.403526:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400256 00000100:00100000:3.0:1787847501.403529:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400256 00000100:00100000:3.0:1787847501.403567:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847501.403575:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616400256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847501.403698:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616400256:12345-0@lo:400:kworker.0 Request processed in 124us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847501.403705:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787847501.403909:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800515e00 x1874693616400256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847501.403920:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800515e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616400256:0@lo:400:kworker.0 00000100:00100000:3.0:1787847501.403988:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005170c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616400000:0@lo:400:kworker.0 00000100:00080000:3.0:1787847501.404033:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787847502.425222:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787847502.545465:0:15410:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787847503.448921:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787847503.769612:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787847504.471312:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847505.495157:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847506.263144:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787847491/real 1787847491] req@ffff8d86c1dbc780 x1874693616396416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847506.263195:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d86c1dbc780 x1874693616396416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847506.263209:0:3299:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787847491/real 1787847491] req@ffff8d86c1dbf0c0 x1874693616396544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847506.263223:0:3299:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d86c1dbf0c0 x1874693616396544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787847506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787847506.263271:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d8800360800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847506.263308:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787847506.263314:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616396416:0@lo:8:kworker.0 00000100:00080000:0.0:1787847506.263321:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787847506.263327:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787847506.263330:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616396544:0@lo:8:kworker.0 00000100:00080000:2.0:1787847506.263554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787847506.263560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787847506.263563:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d8800360800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787847506.263569:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:2.0:1787847506.263576:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787847506.263585:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d8800360800 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847506.263613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d8800368000 x1874693616400512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787847506.263679:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616400512:0@lo:8:kworker.0 00000100:00100000:1.0:1787847506.263768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847506.263928:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847506.263965:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616400384:0@lo:400:kworker.0 00000100:00100000:0.0:1787847506.264007:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847506.264067:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400512 00000100:00100000:0.0:1787847506.264077:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400512 00000100:00100000:0.0:1787847506.264117:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787847506.264127:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1874693616400512:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787847506.264163:0:15042:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 421 last 0 00000020:00000080:0.0:1787847506.264204:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9862d1c 00002000:00100000:0.0:1787847506.264222:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d880075e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113957 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787847506.264227:0:15042:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787847506.264230:0:15042:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787847506.264694:0:15042:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787847506.264726:0:15042:0:(import.c:65:import_set_state_nolock()) ffff8d880075f800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787847506.264838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787847506.264854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787847506.264857:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787847506.264862:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 406 00000100:00080000:2.0:1787847506.264867:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787847506.264887:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d87c32f7000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847506.264908:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d8800369a40 x1874693616400640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787847506.265021:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400384 00000100:00100000:3.0:1787847506.265028:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400384 00000100:00100000:3.0:1787847506.265078:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787847506.265088:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:3302:x1874693616400384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847506.265147:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:3302:x1874693616400384:12345-0@lo:400:kworker.0 Request processed in 60us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847506.265154:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787847506.265220:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616400384:0@lo:400:kworker.0 00000100:00100000:1.0:1787847506.265427:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616400640:0@lo:8:kworker.0 00000100:00100000:1.0:1787847506.265475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847506.265557:0:15045:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787847506.265567:0:15045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787847506.265770:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400640 00000100:00100000:3.0:1787847506.265775:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400640 00000100:00100000:3.0:1787847506.265886:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847506.265892:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3299:x1874693616400640:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1787847506.265913:0:15573:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787847506.265989:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3299:x1874693616400640:12345-0@lo:8:kworker.0 Request processed in 96us (514us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787847506.265997:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847506.267546:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1874693616400512:12345-0@lo:8:kworker.0 Request processed in 3403us (3762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847506.267563:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787847506.268097:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616400768:0@lo:400:kworker.0 00000100:00100000:3.0:1787847506.268181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847506.268217:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847506.268223:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616400896:0@lo:400:kworker.0 00000100:00100000:3.0:1787847506.268249:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847506.268309:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400768 00000100:00100000:3.0:1787847506.268318:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400768 00000100:00100000:3.0:1787847506.268373:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616400896 00000100:00100000:3.0:1787847506.268376:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616400896 00000100:00100000:3.0:1787847506.268407:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847506.268417:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616400768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847506.268479:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616400768:12345-0@lo:400:kworker.0 Request processed in 63us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847506.268486:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847506.268503:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847506.268510:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616400896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847506.268549:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007af0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616400896:12345-0@lo:400:kworker.0 Request processed in 40us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847506.268556:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787847506.268579:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787847506.268616:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800368f00 x1874693616400896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847506.268632:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616400896:0@lo:400:kworker.0 00010000:00080000:3.0:1787847506.268645:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800369680 x1874693616400768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847506.268654:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616400768:0@lo:400:kworker.0 00010000:00080000:1.0:1787847506.270266:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800368000 x1874693616400512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787847526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847506.270285:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787847506.270300:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787847506.270311:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787847506.270319:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787847506.270323:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d8800360800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787847506.270416:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787847506.270425:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616400512:0@lo:8:kworker.0 00000100:00080000:1.0:1787847506.270468:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787847506.270473:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787847506.270477:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616400640:0@lo:8:kworker.0 00000004:00080000:0.0:1787847506.270707:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787847506.271186:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 421095252713ns, next at 0ns, rc = 0 00000004:00080000:2.0:1787847506.281032:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787847506.281076:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1874693616401152:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787847506.281182:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847506.281226:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c60e1180 going to sleep for 11 seconds 00000100:00100000:2.0:1787847506.281256:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847506.281272:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616401024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847506.281301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847506.281342:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401152 00000100:00100000:2.0:1787847506.281351:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401152 00000100:00100000:2.0:1787847506.281427:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787847506.281439:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1874693616401152:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787847506.284162:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401024 00000100:00100000:1.0:1787847506.284178:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401024 00000100:00100000:1.0:1787847506.284246:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847506.284257:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88003683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874693616401024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847506.284303:0:15046:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847506.284412:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88003683c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1874693616401024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847506.284420:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787847506.284482:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d880036b480 x1874693616401024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847522 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847506.284508:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616401024:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787847506.284579:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787847506.291180:0:15045:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787847506.291199:0:15045:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787847506.291207:0:15045:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1787847506.309809:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.309825:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.309865:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.309871:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.309879:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.309901:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.309922:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.309967:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310218:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787847506.310236:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.310243:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310252:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.310258:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310269:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310292:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310301:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310324:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.310332:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.310334:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787847506.310976:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.310984:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.310996:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.311000:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.311005:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.311017:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.311027:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.311035:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.311080:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787847506.311090:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.311096:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.311104:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152ba00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.311107:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.315406:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.315471:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.315482:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000928e3d9d/0x1835de88b9862d2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.315537:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.315539:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.315543:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787847506.319665:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.319688:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.319712:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.319718:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.319727:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.319748:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.319760:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.319780:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.319820:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787847506.322424:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.322440:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.322461:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.322467:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.322474:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.322492:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.322504:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.322525:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.322550:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787847506.323415:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.323424:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.323445:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.323449:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.323455:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.323466:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.323476:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.323486:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.323498:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787847506.323997:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.324007:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.324018:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.324023:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.324029:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.324040:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.324060:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.324068:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.324076:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1787847506.324628:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787847506.324639:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324648:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.324653:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324662:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324687:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324694:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c3d14a8/0x1835de88b9862d31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324720:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787847506.324724:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324730:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.324733:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324740:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324761:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324769:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adc86d6/0x1835de88b9862d38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324781:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847506.324785:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324792:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.324795:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324802:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324812:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324820:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a12a66bc/0x1835de88b9862d3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324834:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.324837:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324852:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.324855:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324863:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324874:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324882:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc9bb6d9/0x1835de88b9862d46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.324896:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.324898:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.324900:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847506.325213:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787847506.328355:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.328376:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.328399:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.328406:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.328414:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.328433:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.328445:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.328454:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.328550:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787847506.329230:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.329238:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.329250:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.329253:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.329258:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.329269:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.329278:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.329286:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331096:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787847506.331132:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787847506.331143:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331158:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152a800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.331179:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331192:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331218:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331226:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a856d1a/0x1835de88b9862d4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331255:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.331259:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331266:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.331269:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331275:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331285:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331292:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059ec5368/0x1835de88b9862d54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.331314:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.331316:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.331318:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787847506.333508:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787847506.333535:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.333554:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=421s v=(0 0) 00010000:00010000:2.0:1787847506.333559:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847506.333566:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.333580:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.333592:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.333599:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.334062:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.339252:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1787847506.340213:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787847506.340227:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.340249:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787847506.340264:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847506.340274:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.340294:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.340306:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.340315:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787847506.341152:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787847506.341498:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.341522:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165de00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.341527:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.341538:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.341572:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.341580:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000276a957a/0x1835de88b9862d5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.342030:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.342038:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.342048:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7c00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.342052:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.342060:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.342072:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.342081:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.342083:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.342086:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847506.342870:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787847506.342882:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e73a64f/0x1835de88b9862d62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.344166:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787847506.344256:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787847506.344266:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.344283:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787847506.344288:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847506.344296:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.344313:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.344333:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.344343:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.344397:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787847506.344964:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787847506.344971:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.344982:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787847506.344986:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847506.344991:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.345000:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.345008:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.345015:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.347499:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787847506.347554:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787847506.348379:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787847506.348392:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.348411:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787847506.348416:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847506.348423:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.348439:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.348449:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.348457:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351318:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787847506.351339:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351379:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6c00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.351385:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351398:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351426:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351434:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9e864f0/0x1835de88b9862d70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351463:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.351468:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351475:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.351479:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351486:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351497:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.351524:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.351526:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.351528:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.355848:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.355909:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.355915:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.355961:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.355993:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.356001:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a0efcc5/0x1835de88b9862d69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.356232:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.356237:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.356241:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847506.358785:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787847506.358805:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a566bedc/0x1835de88b9862d77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847506.361106:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787847506.361124:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.361157:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787847506.361162:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847506.361171:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.361191:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.361203:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.361210:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.361669:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.361681:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.361692:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.361697:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.361708:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.361731:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.361746:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.361748:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.361750:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847506.364227:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787847506.364246:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c27ee8f/0x1835de88b9862d7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787847506.367378:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787847506.367399:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.367423:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1787847506.367428:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787847506.367437:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.367477:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.367491:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847506.367500:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.367772:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.367783:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.367807:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6e00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.367813:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.367822:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.367856:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.367884:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.367886:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.367889:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847506.368340:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787847506.368347:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e79e126/0x1835de88b9862d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847506.377999:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.378019:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.378042:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.378047:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.378056:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.378076:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.378088:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.378096:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.378170:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847506.378181:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.378190:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847506.378195:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.378205:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.378228:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847506.378255:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.378257:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.378259:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847506.383617:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787847506.383628:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847506.383653:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f97412a/0x1835de88b9862d8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847506.385080:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.385095:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.385416:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.385430:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.385438:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.385456:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.385468:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.385476:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.385503:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847506.386165:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.386176:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.386187:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4e00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.386192:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.386203:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.386227:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.386243:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe53f58d/0x1835de88b9862d93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.386268:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.386270:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.386272:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787847506.386450:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.386457:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.386468:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.386472:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.386478:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.386489:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.386499:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.386526:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.386556:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787847506.387044:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.387052:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.387064:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.387067:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.387071:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.387083:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.387091:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.387099:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.387113:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787847506.388052:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.388063:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.388086:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.388090:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.388096:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.388173:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.388183:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.388191:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.388203:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787847506.388852:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847506.388908:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787847506.388920:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.388947:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4a00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.388953:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.388963:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.388987:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.388995:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098fb3b59/0x1835de88b9862d9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389018:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847506.389022:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389036:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.389039:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389045:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389055:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389062:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e034948/0x1835de88b9862da1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389076:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.389078:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389084:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.389088:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389094:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389101:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389115:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017971d8f/0x1835de88b9862da8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389129:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.389131:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.389133:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.389143:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847506.389195:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389207:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.389211:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.389216:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389227:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389248:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389255:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389281:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847506.389460:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.389466:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389474:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f4200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.389477:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389486:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389499:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389506:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0a2f7c8/0x1835de88b9862daf lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.389530:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.389532:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.389539:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787847506.389784:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.389791:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389801:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.389804:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.389809:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389819:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389826:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.389834:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.390639:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787847506.391524:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.391536:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.391554:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.391559:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.391566:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.391579:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.391588:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.391596:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.391612:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787847506.393373:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.393393:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.393413:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.393425:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.393432:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.393447:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.393458:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.393466:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.393479:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787847506.393668:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787847506.393678:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393687:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c14f5a00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.393692:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393702:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393725:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393734:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000219f6639/0x1835de88b9862db6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393760:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847506.393765:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393772:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801878200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.393775:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393782:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393803:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393810:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a074e45f/0x1835de88b9862dbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393826:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.393829:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393836:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.393839:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393847:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393857:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393864:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9862dc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.393876:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.393878:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.393886:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.393896:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787847506.398201:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.398218:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.398243:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.398248:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.398255:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.398272:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.398284:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.398300:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.398327:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847506.398412:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.398423:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.398433:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801878a00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.398438:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.398448:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.398470:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.398477:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003882839f/0x1835de88b9862dcb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.398503:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.398505:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.398507:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787847506.399572:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.399583:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.399600:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.399605:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.399610:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.399623:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.399647:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.399655:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.399677:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847506.400190:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.400200:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400210:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879a00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.400214:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400232:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787847506.400243:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.400248:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400250:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400259:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb553995/0x1835de88b9862dd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.400261:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.400265:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.400269:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.400278:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.400286:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.400294:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400309:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847506.400311:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787847506.400313:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400320:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801878000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.400323:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400332:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400343:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400351:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a73ce6/0x1835de88b9862dd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.400375:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.400377:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.400379:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847506.400490:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787847506.400951:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787847506.400959:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.400970:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=421s v=(0 0) 00010000:00010000:1.0:1787847506.400974:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847506.400979:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.400989:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.401008:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.401015:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847506.401030:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787847506.401281:0:15045:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1787847506.401415:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14381:x1874693616401152:12345-0@lo:5:osp-pre-0-0.0 Request processed in 119973us (120228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847506.401443:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787847506.401506:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1874693616401152:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787847506.401538:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787847506.401598:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1874693616401280:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787847506.401643:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847506.401705:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7a183c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847506.401827:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401280 00000100:00100000:1.0:1787847506.401835:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401280 00000100:00100000:1.0:1787847506.401900:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787847506.401912:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14381:x1874693616401280:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787847506.401991:0:15573:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1787847506.403039:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847506.403054:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.403073:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879000 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847506.403077:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.403089:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.403114:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.403124:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b976424f/0x1835de88b9862de0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847506.403156:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.403158:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847506.403160:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847506.410680:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14381:x1874693616401280:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8759us (9026us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787847506.410695:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787847506.410886:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14381:1874693616401280:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787847506.410907:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787847506.519400:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847506.640828:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1787847506.640850:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1787847507.556027:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847508.568065:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847509.598158:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787847510.604378:0:15762:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787847510.604383:0:15762:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787847510.604614:0:15762:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d86c18b4000 00000020:01000004:3.0:1787847510.604636:0:15762:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787847510.604655:0:15762:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787847510.604675:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d8801884d70) 00000020:00000080:3.0:1787847510.604697:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1787847510.618100:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787847510.635323:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787847510.636452:0:15762:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787847510.640035:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787847510.640509:0:15762:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787847510.640784:0:15762:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787847510.641383:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 603: rc = 0 00100000:10000000:2.0:1787847510.641550:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 603: rc = 0 00100000:10000000:2.0:1787847510.641657:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 603: rc = 0 00100000:10000000:2.0:1787847510.642481:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 739: rc = 0 00100000:10000000:2.0:1787847510.644153:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 739: rc = 0 00100000:10000000:2.0:1787847510.644594:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 739: rc = 0 00100000:10000000:2.0:1787847510.646337:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 739: rc = 0 00100000:10000000:2.0:1787847510.648947:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 739: rc = 0 00100000:10000000:2.0:1787847510.649352:0:15762:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 739: rc = 0 00000020:00000080:3.0:1787847510.654223:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787847510.654241:0:15762:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787847510.654257:0:15762:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1835de88b9862dee 00000020:01000004:3.0:1787847510.654269:0:15762:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787847510.654298:0:15762:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787847510.654303:0:15762:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787847510.654321:0:15762:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787847510.654349:0:15762:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787847510.654354:0:15762:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787847510.670002:0:15762:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787847510.670063:0:15762:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.121@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787847510.670068:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787847510.670071:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787847510.670072:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787847510.670073:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787847510.670074:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787847510.670076:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787847510.670078:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787847510.670079:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787847510.670081:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787847510.670085:0:15762:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787847510.670088:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787847510.670089:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787847510.670091:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787847510.670092:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787847510.670093:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787847510.670094:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787847510.670095:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787847510.670096:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787847510.670097:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787847510.670132:0:15762:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787847510.670160:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401408:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787847510.670274:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847510.670336:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c60e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.670609:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401408 00000100:00100000:3.0:1787847510.670619:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401408 00000100:00100000:3.0:1787847510.670704:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787847510.670716:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15762:x1874693616401408:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787847510.670766:0:14351:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787847510.670770:0:14351:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787847510.670775:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787847510.697897:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15762:x1874693616401408:12345-0@lo:253:mount.lustre.0 Request processed in 27111us (27551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847510.697917:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787847510.698164:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401408:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787847510.698185:0:15762:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787847510.698190:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787847510.698192:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787847510.698193:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787847510.698195:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787847510.698196:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787847510.698197:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787847510.698199:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787847510.698201:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787847510.698203:0:15762:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787847510.698230:0:15762:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d86c18b4000 from lustre-OST0001 10000000:01000000:0.0:1787847510.698268:0:15762:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787847510.698291:0:15762:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787847510.698301:0:15762:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d86c18b8000 local copy 00010000:00010000:0.0:1787847510.698317:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847510.698640:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787847510.699204:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847510.699307:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c60e1180 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.699356:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401536 00000100:00100000:3.0:1787847510.699365:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401536 00000100:00100000:3.0:1787847510.699467:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787847510.699478:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15762:x1874693616401536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847510.699860:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15762:x1874693616401536:12345-0@lo:501:mount.lustre.0 Request processed in 382us (656us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787847510.699870:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787847510.700132:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbf0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787847510.700166:0:15762:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787847510.700351:0:15762:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787847510.700360:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847510.700374:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6000/0x1835de88b9862b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862b9b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847510.700408:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d86c18b4000 10000000:01000000:1.0:1787847510.700414:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787847510.700420:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787847510.700423:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787847510.700428:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787847510.700431:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787847510.700479:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847510.700488:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847510.700500:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847510.700522:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800515a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787847510.700564:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.700655:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f5121240 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.700879:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401664 00000100:00100000:3.0:1787847510.700886:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401664 00000100:00100000:3.0:1787847510.700962:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787847510.700972:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:15762:x1874693616401664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847510.700986:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847510.701003:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9862dfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862df5 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.701030:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9862dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862df5 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.701042:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6e00/0x1835de88b9862dfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862df5 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.701061:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6e00, rc 0) 00000100:00100000:3.0:1787847510.701100:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616401664:12345-0@lo:101:mount.lustre.0 Request processed in 129us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.701108:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787847510.701318:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800515a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847510.701334:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862dfc expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847510.701344:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862dfc expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847510.702419:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787847510.705282:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847510.705654:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787847510.705736:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787847510.705773:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787847510.705824:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787847510.706132:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787847510.706171:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787847510.706250:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787847510.706259:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787847510.706393:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847510.706501:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.706561:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.706793:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401792 00000100:00100000:3.0:1787847510.706804:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401792 00000100:00100000:3.0:1787847510.706964:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787847510.706977:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616401792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847510.707394:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616401792:12345-0@lo:501:mount.lustre.0 Request processed in 419us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.707402:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787847510.707586:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847510.707631:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847510.707838:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.707964:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.708017:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616401920 00000100:00100000:0.0:1787847510.708024:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616401920 00000100:00100000:0.0:1787847510.708057:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787847510.708066:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616401920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787847510.708445:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616401920:12345-0@lo:503:mount.lustre.0 Request processed in 369us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.708454:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787847510.711141:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616401920:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787847510.712176:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787847510.712314:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402048:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847510.712413:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.712477:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.713739:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402048 00000100:00100000:3.0:1787847510.713755:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402048 00000100:00100000:3.0:1787847510.713824:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787847510.713835:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616402048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787847510.714225:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616402048:12345-0@lo:502:mount.lustre.0 Request processed in 390us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.714235:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787847510.714516:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787847510.714819:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787847510.714900:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787847510.714970:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787847510.715029:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787847510.715069:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787847510.715105:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787847510.715154:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787847510.715193:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787847510.715244:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787847510.715292:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005170c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847510.715361:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.715400:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f5121e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.715609:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402176 00000100:00100000:0.0:1787847510.715617:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402176 00000100:00100000:0.0:1787847510.715674:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787847510.715685:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616402176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787847510.715919:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616402176:12345-0@lo:502:mount.lustre.0 Request processed in 235us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.715928:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787847510.716973:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005170c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787847510.717105:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787847510.717123:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787847510.718365:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787847510.718379:0:15763:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787847510.718387:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.718390:0:15763:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787847510.718396:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787847510.718415:0:15763:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d86c18b99d0) 00000020:00000080:0.0:1787847510.718461:0:15763:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787847510.718470:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787847510.718550:0:15763:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d86c18b4000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787847510.718560:0:15763:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787847510.718567:0:15763:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1835de88b9862e0a 00010000:00010000:0.0:1787847510.728503:0:15763:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787847510.731241:0:15763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787847510.739376:0:15763:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787847510.746865:0:15763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787847510.746883:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847510.746892:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847510.746894:0:15763:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787847510.746897:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847510.746902:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847510.746904:0:15763:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787847510.746907:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787847510.746909:0:15763:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787847510.746911:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847510.746914:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847510.746915:0:15763:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787847510.746917:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787847510.746920:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847510.746921:0:15763:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787847510.746924:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787847510.747057:0:15763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787847510.747061:0:15763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787847510.747063:0:15763:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787847510.747066:0:15763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787847510.747332:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787847510.747367:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787847510.747393:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862dfc expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.747409:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d8801878c00/0x1835de88b9862df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862dfc expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847510.747432:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d86c18b4000 from 1 10000000:01000000:3.0:1787847510.747445:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787847510.747494:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.747503:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.747516:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847510.747547:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402304:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847510.747635:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847510.747692:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402304 00000100:00100000:3.0:1787847510.747700:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402304 00000100:00100000:3.0:1787847510.747754:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787847510.747766:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:15762:x1874693616402304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847510.747783:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847510.747798:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862e11 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.747827:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862e11 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.747853:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862e11 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.747864:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7000, rc 0) 00000100:00100000:3.0:1787847510.747910:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402304:12345-0@lo:101:mount.lustre.0 Request processed in 146us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.747920:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787847510.748011:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d3d4d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.748038:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402304:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787847510.748055:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.748065:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787847510.748651:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787847510.749102:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847510.749338:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787847510.749393:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787847510.749462:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787847510.749470:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787847510.749540:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787847510.749591:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847510.749615:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d3d4d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.753272:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402432 00000100:00100000:0.0:1787847510.753292:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402432 00000100:00100000:0.0:1787847510.753393:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787847510.753407:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787847510.755300:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402432:12345-0@lo:501:mount.lustre.0 Request processed in 1883us (5694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.755316:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787847510.756168:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847510.756256:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787847510.756327:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.756381:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.756471:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402560 00000100:00100000:3.0:1787847510.756479:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402560 00000100:00100000:3.0:1787847510.756542:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787847510.756554:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787847510.759194:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402560:12345-0@lo:503:mount.lustre.0 Request processed in 2630us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.759214:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787847510.761301:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402560:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787847510.763487:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787847510.763607:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847510.763712:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.763771:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76090c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847510.764798:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402688 00000100:00100000:1.0:1787847510.764812:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402688 00000100:00100000:1.0:1787847510.764894:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787847510.764905:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402688:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847510.766124:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402688:12345-0@lo:502:mount.lustre.0 Request processed in 1211us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847510.766139:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787847510.766149:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787847510.766532:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787847510.766599:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787847510.766643:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787847510.766766:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787847510.766799:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787847510.767033:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787847510.767075:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787847510.767110:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787847510.767163:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402816:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787847510.767231:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.767330:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76090c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847510.768869:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402816 00000100:00100000:3.0:1787847510.768895:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402816 00000100:00100000:3.0:1787847510.768986:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787847510.768997:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880012e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402816:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787847510.769320:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880012e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402816:12345-0@lo:502:mount.lustre.0 Request processed in 324us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.769330:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787847510.769423:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787847510.769613:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787847510.769631:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1787847510.777206:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847510.777224:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.777227:0:15767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787847510.777234:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d86c18b4000 00000020:00000080:0.0:1787847510.777237:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847510.777247:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847510.777250:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.777252:0:15767:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787847510.777254:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847510.777257:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.777258:0:15767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787847510.777262:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d86c18b4000 00000020:00000080:0.0:1787847510.777264:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847510.777333:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847510.777336:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.777337:0:15767:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787847510.777339:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787847510.777359:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.777360:0:15767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787847510.777364:0:15767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d86c18b4000 00000020:00000080:0.0:1787847510.777365:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787847510.777403:0:15767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787847510.777406:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787847510.777407:0:15767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787847510.777410:0:15767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787847510.777627:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787847510.777676:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787847510.777706:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.777719:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847510.777768:0:15762:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787847510.777772:0:15762:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d86c18b4000 10000000:01000000:3.0:1787847510.777775:0:15762:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d86c18b4000 10000000:01000000:3.0:1787847510.777780:0:15762:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787847510.777786:0:15762:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d86c18b4000 from 1 10000000:01000000:3.0:1787847510.777789:0:15762:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787847510.777835:0:15762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.777856:0:15762:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.777881:0:15762:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847510.777911:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787847510.778062:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847510.778114:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c337a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.778367:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616402944 00000100:00100000:0.0:1787847510.778376:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616402944 00000100:00100000:0.0:1787847510.778431:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787847510.778451:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616402944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787847510.778467:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847510.778482:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862e26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862e1f expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.778510:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862e1f expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.778521:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6afe000/0x1835de88b9862e26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862e1f expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.778532:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe000, rc 0) 00000100:00100000:0.0:1787847510.778589:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616402944:12345-0@lo:101:mount.lustre.0 Request processed in 140us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.778597:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787847510.778699:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616402944:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787847510.778716:0:15762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e26 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847510.778727:0:15762:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862e26 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847510.784055:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787847510.785744:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787847510.790601:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787847510.790736:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787847510.790785:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787847510.790852:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787847510.790904:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787847510.790990:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787847510.791033:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787847510.791067:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787847510.791144:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787847510.791185:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787847510.791225:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787847510.791297:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787847510.791347:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787847510.791391:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787847510.796254:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787847510.796508:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787847510.796555:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787847510.796622:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787847510.796660:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787847510.796694:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787847510.796747:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787847510.796786:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787847510.796822:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787847510.796873:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787847510.796971:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787847510.797008:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787847510.797055:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787847510.797086:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787847510.797115:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787847510.797159:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787847510.797195:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787847510.797504:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787847510.797552:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787847510.797624:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787847510.798511:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787847510.798606:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787847510.798648:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787847510.799559:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787847510.799574:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787847510.799727:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787847510.799827:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.799885:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.802591:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403072 00000100:00100000:0.0:1787847510.802611:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403072 00000100:00100000:0.0:1787847510.802684:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787847510.802698:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787847510.803132:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403072:12345-0@lo:501:mount.lustre.0 Request processed in 436us (3304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.803142:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787847510.804531:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787847510.804608:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787847510.804680:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847510.804735:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f9c49a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847510.804795:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403200 00000100:00100000:1.0:1787847510.804804:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403200 00000100:00100000:1.0:1787847510.804870:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787847510.804881:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403200:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787847510.805143:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403200:12345-0@lo:503:mount.lustre.0 Request processed in 264us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847510.805151:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787847510.805221:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbc780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403200:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787847510.806486:0:15762:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787847510.806584:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005170c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847510.806643:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.807091:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c515b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.807312:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403328 00000100:00100000:0.0:1787847510.807651:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403328 00000100:00100000:0.0:1787847510.807720:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787847510.807732:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847510.808543:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403328:12345-0@lo:502:mount.lustre.0 Request processed in 808us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847510.808555:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787847510.809517:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005170c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787847510.809897:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787847510.810068:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787847510.810122:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787847510.810180:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787847510.810219:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787847510.810274:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787847510.810316:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787847510.810352:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787847510.810409:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787847510.810462:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787847510.810501:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787847510.810553:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787847510.810593:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787847510.810628:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787847510.810834:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787847510.810967:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787847510.811006:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787847510.811057:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787847510.811094:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787847510.811130:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787847510.811181:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787847510.811218:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787847510.811252:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787847510.811318:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787847510.811350:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787847510.811381:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787847510.811424:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787847510.811479:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787847510.811518:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787847510.811581:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787847510.811626:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787847510.812164:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787847510.812209:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787847510.812266:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787847510.812304:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787847510.812350:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787847510.812391:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787847510.812421:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787847510.812488:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787847510.812524:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787847510.812588:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800515e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403456:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787847510.814063:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.814121:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c515b600 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.814419:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403456 00000100:00100000:0.0:1787847510.814430:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403456 00000100:00100000:0.0:1787847510.814507:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787847510.814517:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403456:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787847510.814841:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616403456:12345-0@lo:502:mount.lustre.0 Request processed in 323us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.814850:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787847510.815146:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800515e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616403456:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787847510.815283:0:15762:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787847510.815303:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787847510.818297:0:15772:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787847510.818447:0:15772:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d87c60933a0) 00000020:00000080:2.0:1787847510.818476:0:15772:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787847510.818587:0:15772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d86c18b4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787847510.818593:0:15772:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d86c18b4000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787847510.818596:0:15772:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d86c18b4000 3 00010000:00080000:2.0:1787847510.818639:0:15772:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d87c61f2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.121@tcp at head 00010000:00010000:2.0:1787847510.824352:0:15772:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787847510.824636:0:15772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787847510.824687:0:15772:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787847510.824705:0:15772:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1835de88b9862e34 00000100:00080000:2.0:1787847510.824719:0:15772:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787847510.824727:0:15772:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d87c61f2000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847510.824775:0:15772:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d8800369680 x1874693616403584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787847510.824811:0:15772:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787847510.824835:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616403584:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1787847510.824867:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787847510.824872:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787847510.824875:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787847510.824880:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:2.0:1787847510.824891:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787847510.824895:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d87c32f7000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:2.0:1787847510.824910:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d880036ad00 x1874693616403840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787847510.825333:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.825401:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616403840:0@lo:8:kworker.0 00000100:00100000:1.0:1787847510.825432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.825480:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616403712:0@lo:400:kworker.0 00000100:00100000:1.0:1787847510.825508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.825563:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403840 00000100:00100000:3.0:1787847510.825569:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616403968:0@lo:400:kworker.0 00000100:00100000:1.0:1787847510.825572:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403840 00000100:00100000:1.0:1787847510.825612:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403712 00000100:00100000:3.0:1787847510.825613:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.825617:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403712 00000100:00100000:3.0:1787847510.825643:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847510.825652:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616404096:0@lo:400:kworker.0 00000100:00100000:3.0:1787847510.825677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.825752:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847510.825767:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616403712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847510.825831:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616403712:12345-0@lo:400:kworker.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847510.825990:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847510.826011:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847510.826016:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1874693616403840:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787847510.826070:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1874693616403840:12345-0@lo:8:kworker.0 Request processed in 54us (637us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787847510.826076:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787847510.826099:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847510.826133:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787847510.826158:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616403712:0@lo:400:kworker.0 00000100:00100000:1.0:1787847510.826192:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787847510.826198:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787847510.826203:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787847510.826206:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616403840:0@lo:8:kworker.0 00000100:00100000:2.0:1787847510.827264:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403584 00000100:00100000:2.0:1787847510.827275:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403584 00000100:00100000:2.0:1787847510.827301:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616403968 00000100:00100000:2.0:1787847510.827304:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616403968 00000100:00100000:2.0:1787847510.827357:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404096 00000100:00100000:2.0:1787847510.827361:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404096 00000100:00080000:1.0:1787847510.827599:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847510.828404:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787847510.828416:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847510.828530:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007acf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616403968:12345-0@lo:400:kworker.0 Request processed in 116us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847510.828537:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787847510.828558:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847510.828566:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847510.828602:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1874693616404096:12345-0@lo:400:kworker.0 Request processed in 37us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847510.828608:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787847510.828623:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787847510.828628:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1874693616403584:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787847510.828655:0:14358:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:2.0:1787847510.828696:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1835de88b9862e3b 00000004:00100000:2.0:1787847510.828716:0:14358:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787847510.828755:0:14358:0:(import.c:65:import_set_state_nolock()) ffff8d87c2bad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847510.828813:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1874693616403584:12345-0@lo:38:llog_process_th.0 Request processed in 184us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847510.828822:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787847510.828883:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800369680 x1874693616403584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787847520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787847510.828898:0:3299:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787847510.828907:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787847510.828916:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787847510.828928:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787847510.828960:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87c61f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787847510.828968:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1874693616403584:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787847510.829080:0:15772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787847510.829176:0:15762:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787847510.829214:0:15762:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787847510.829236:0:15762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e26 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847510.829249:0:15762:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7c00/0x1835de88b9862e1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e26 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787847510.829309:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787847510.829313:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847510.829314:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847510.829315:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847510.829316:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847510.829318:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847510.829320:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847510.829322:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847510.829324:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787847510.829328:0:15762:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787847510.829332:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787847510.829333:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787847510.829334:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787847510.829335:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787847510.829336:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787847510.829337:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787847510.829338:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787847510.829340:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787847510.829341:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787847510.829365:0:15762:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787847510.829384:0:15762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800514000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616404224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787847510.829460:0:15762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.829499:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404224 00000100:00100000:1.0:1787847510.829504:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404224 00000100:00100000:1.0:1787847510.829540:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787847510.829547:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:15762:x1874693616404224:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787847510.829570:0:14352:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787847510.829587:0:14352:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787847510.831569:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d8800369e00 x1874693616404096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847510.831592:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1874693616404096:0@lo:400:kworker.0 00010000:00080000:3.0:1787847510.831608:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d88003692c0 x1874693616403968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787847510.831618:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88003692c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616403968:0@lo:400:kworker.0 00000100:00100000:0.0:1787847510.835026:0:15762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c515b300 going to sleep for 11 seconds 20000000:01000000:1.0:1787847510.891614:0:14352:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787847510.891641:0:14352:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787847510.891802:0:14374:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787847510.891809:0:14374:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787847510.891852:0:14374:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847510.891876:0:14374:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862d0e expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847510.891886:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847510.891967:0:14374:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862d0e expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847510.891985:0:14374:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862d0e expref: 19 pid: 14353 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847510.892003:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1874693616404352:0@lo:104: 00000100:00100000:2.0:1787847510.892095:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847510.892159:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e76093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847510.892174:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404352 00000100:00100000:0.0:1787847510.892186:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404352 00000100:00100000:0.0:1787847510.892259:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787847510.892270:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14374:x1874693616404352:12345-0@lo:104: 00010000:00010000:0.0:1787847510.892303:0:14342:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.892392:0:14342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787847510.892400:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:14374:x1874693616404352:12345-0@lo:104: Request processed in 131us (305us total) trans 0 rc 0/0 00010000:00010000:3.0:1787847510.892405:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787847510.892412:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787847510.892415:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.892425:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87f152b600 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:3.0:1787847510.892430:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.892461:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787847510.892468:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847510.892474:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787847510.892515:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.892521:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787847510.892542:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.892550:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87f152b600/0x1835de88b9862d0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862d15 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847510.892577:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847510.892579:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847510.892581:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847510.892638:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616404480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847510.892817:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847510.893025:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14374:1874693616404352:0@lo:104: 00010000:00010000:1.0:1787847510.893052:0:14374:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847510.893079:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404480 00000100:00100000:0.0:1787847510.893086:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404480 00010000:00010000:0.0:1787847510.893112:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862d0e expref: 20 pid: 14353 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847510.893152:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787847510.893160:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d674ef9-f2fc-448e-8206-e13ebe069dba+20:3302:x1874693616404480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847510.893194:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847510.893202:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862d0e expref: 20 pid: 14353 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893216:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862d0e expref: 20 pid: 14353 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893235:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862d15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862d0e expref: 20 pid: 14353 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893251:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893261:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787847510.893286:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002563786s 00010000:00010000:0.0:1787847510.893291:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893299:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893306:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893314:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893556:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847510.893561:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893570:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893586:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847510.893600:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847510.893661:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3302:x1874693616404480:12345-0@lo:103:ldlm_bl.0 Request processed in 500us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847510.893670:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787847510.894010:0:14374:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847510.894023:0:14374:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847510.894030:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c165d200/0x1835de88b9862e42 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14374 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847510.894152:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616404480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847510.915712:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:15762:x1874693616404224:12345-0@lo:253:mount.lustre.0 Request processed in 86142us (86229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847510.915734:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787847510.915761:0:15762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800514000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1d674ef9-f2fc-448e-8206-e13ebe069dba:15762:1874693616404224:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787847510.915788:0:15762:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787847510.915810:0:15762:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787847510.915812:0:15762:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787847510.915814:0:15762:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787847510.915815:0:15762:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787847510.915817:0:15762:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787847510.915818:0:15762:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787847510.915820:0:15762:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787847510.915822:0:15762:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787847510.915823:0:15762:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787847510.915842:0:15762:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787847510.928172:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787847510.930865:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787847510.941117:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847510.941460:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787847510.942356:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787847510.943303:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787847510.944906:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787847511.026342:0:15762:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787847511.026356:0:15762:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787847511.026397:0:15762:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787847511.026702:0:15762:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787847511.026720:0:15762:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787847511.026760:0:15762:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787847511.641292:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847511.643280:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616404608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787847511.643387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847511.643607:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404608 00000100:00100000:3.0:1787847511.643618:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404608 00000100:00100000:3.0:1787847511.643677:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847511.643688:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616404608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847511.647820:0:15046:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847511.648393:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007acb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616404608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4700us (4999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847511.648407:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787847511.648821:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007aed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616404608:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787847512.599381:0:14356:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787847512.599392:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d87e6e62000 from 8 10000000:01000000:2.0:1787847512.599399:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787847512.599477:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847512.599491:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847512.599504:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847512.599538:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616404736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787847512.599635:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847512.599706:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847512.600105:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404736 00000100:00100000:0.0:1787847512.600116:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404736 00000100:00100000:0.0:1787847512.600183:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787847512.600194:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616404736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847512.600211:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847512.600229:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862e49 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847512.600261:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862e49 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847512.600273:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff800/0x1835de88b9862e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862e49 expref: 19 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847512.600283:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff800, rc 0) 00000100:00100000:0.0:1787847512.600336:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616404736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847512.600343:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787847512.600462:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616404736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847512.600481:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e50 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847512.600491:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862e50 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847512.600560:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616404864:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787847512.600604:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847512.600637:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787847512.603311:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404864 00000100:00100000:1.0:1787847512.603327:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404864 00000100:00100000:1.0:1787847512.603393:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787847512.603419:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616404864:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787847512.603451:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787847512.603472:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787847512.603480:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787847512.603629:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616404864:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 226us (3023us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847512.603638:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787847512.604096:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616404864:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787847512.604181:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787847512.604194:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e50 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847512.604206:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165ce00/0x1835de88b9862e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862e50 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847512.664702:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787847513.049039:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787847513.687064:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847514.711107:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847515.735129:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787847516.247214:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787847516.247221:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787847516.247225:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787847516.247238:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d87c32f7000 using connection 192.168.201.121@tcp/0@lo 00000100:00100000:1.0:1787847516.247260:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d8800516d00 x1874693616405248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787847516.247905:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d674ef9-f2fc-448e-8206-e13ebe069dba:3300:1874693616404992:0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.248019:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847516.248067:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616405632:0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.248094:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847516.248120:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787847516.248126:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800514b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616405120:0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.248151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847516.248179:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616405504:0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.248216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847516.248238:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787847516.248243:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800514f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616405376:0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.248782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847516.248822:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616404992 00000100:00100000:1.0:1787847516.248830:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616404992 00000100:00100000:1.0:1787847516.248879:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787847516.248890:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3300:x1874693616404992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.248968:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3300:x1874693616404992:12345-0@lo:400:kworker.0 Request processed in 81us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847516.248976:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787847516.249014:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405632 00000100:00100000:1.0:1787847516.249018:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405632 00000100:00100000:1.0:1787847516.249052:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405504 00000100:00100000:1.0:1787847516.249056:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405504 00000100:00100000:1.0:1787847516.249069:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405376 00000100:00100000:1.0:1787847516.249072:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405376 00000100:00100000:1.0:1787847516.249084:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847516.249095:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616405632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.249130:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616405632:12345-0@lo:400:kworker.0 Request processed in 40us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847516.249136:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787847516.249149:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847516.249154:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.249186:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616405504:12345-0@lo:400:kworker.0 Request processed in 32us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847516.249192:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847516.249213:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787847516.249219:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847516.249248:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616405376:12345-0@lo:400:kworker.0 Request processed in 29us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847516.249254:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787847516.249580:0:3299:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616405248:0@lo:8:kworker.0 00000100:00100000:0.0:1787847516.249619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847516.249695:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405120 00000100:00100000:0.0:1787847516.249700:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405120 00000100:00100000:0.0:1787847516.249733:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405248 00000100:00100000:0.0:1787847516.249737:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405248 00000100:00100000:0.0:1787847516.249755:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847516.249763:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847516.249799:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616405120:12345-0@lo:400:kworker.0 Request processed in 38us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847516.249805:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787847516.249819:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787847516.249823:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1874693616405248:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787847516.249849:0:15045:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:0.0:1787847516.249882:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1835de88b9862e57 00002000:00100000:0.0:1787847516.249896:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d87ef01b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113957 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787847516.249900:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787847516.249903:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787847516.250876:0:15045:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787847516.250905:0:15045:0:(import.c:65:import_set_state_nolock()) ffff8d87ef019000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787847516.250991:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1874693616405248:12345-0@lo:8:kworker.0 Request processed in 1164us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847516.251000:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787847516.251056:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800516d00 x1874693616405248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787847541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787847516.251071:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787847516.251086:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787847516.251091:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787847516.251094:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8d87c32f7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787847516.252379:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787847516.252392:0:3299:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800516d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1874693616405248:0@lo:8:kworker.0 00000100:00080000:0.0:1787847516.253023:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847516.253031:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847516.255015:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800514b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616405120:0@lo:400:kworker.0 00000100:00100000:0.0:1787847516.255032:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88005161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d674ef9-f2fc-448e-8206-e13ebe069dba:3300:1874693616404992:0@lo:400:kworker.0 00010000:00080000:0.0:1787847516.255051:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800514000 x1874693616405632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847516.255062:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616405632:0@lo:400:kworker.0 00000100:00100000:3.0:1787847516.257428:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616405760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847516.257505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787847516.257713:0:14383:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787847516.257738:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1874693616405888:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787847516.257824:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847516.257843:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e7609240 going to sleep for 11 seconds 00000100:00100000:2.0:1787847516.257983:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405760 00000100:00100000:2.0:1787847516.257999:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405760 00000100:00100000:2.0:1787847516.258067:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787847516.258079:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616405760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847516.258113:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847516.258173:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616405760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847516.258180:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787847516.258207:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787847516.258326:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800514f00 x1874693616405376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847516.258351:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800514f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616405376:0@lo:400:kworker.0 00010000:00080000:0.0:1787847516.258367:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d8800517840 x1874693616405504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787847532 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847516.258376:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800517840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616405504:0@lo:400:kworker.0 00000004:00080000:1.0:1787847516.258673:0:14382:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787847516.259003:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616405888 00010000:00080000:3.0:1787847516.259014:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d86c1dbc3c0 x1874693616405760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787847532 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787847516.259015:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616405888 00000100:00100000:3.0:1787847516.259038:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616405760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847516.259057:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787847516.259066:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1874693616405888:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787847516.260949:0:14382:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431085014617ns, next at 0ns, rc = 0 00002000:00080000:0.0:1787847516.266727:0:15045:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787847516.266739:0:15045:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787847516.266756:0:15045:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1787847516.272320:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.272333:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.273094:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.273100:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.273109:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.273131:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.273142:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.273149:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.273771:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787847516.274134:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847516.274143:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.274155:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847516.274160:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.274170:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.274490:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.274498:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862e5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.274519:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847516.274521:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847516.274523:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.275198:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.275208:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.276553:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.276558:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.276566:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.276580:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.276591:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.276599:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.276634:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787847516.276834:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787847516.276842:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847516.276850:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:2.0:1787847516.276854:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847516.276864:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847516.276885:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847516.276893:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862e65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847516.276916:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847516.276918:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847516.276924:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.278137:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.278147:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278161:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.278165:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.278171:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278184:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278205:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278213:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278246:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.278259:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.278264:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278271:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.278275:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278283:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278297:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278304:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862e6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.278320:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.278327:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.278329:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.281861:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.281875:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.281892:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.281897:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.281904:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.281918:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.281953:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.281962:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.281990:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787847516.282602:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.282608:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.282618:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.282621:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.282626:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.282644:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.282652:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.282659:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.282837:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787847516.283266:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.283271:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.283281:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.283284:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.283288:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.283303:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.283311:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.283328:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283533:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787847516.283541:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283550:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847516.283555:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283565:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283584:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283592:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862e73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283612:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787847516.283616:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283622:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847516.283625:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283633:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283657:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283664:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862e7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283677:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847516.283680:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283686:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847516.283690:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283697:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283706:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.283715:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847516.283717:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847516.283719:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847516.287046:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.287503:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787847516.287514:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862e81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.287875:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.292207:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.293201:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.293321:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.293326:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.293333:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.293359:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.293370:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.293378:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.293493:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787847516.294628:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.294638:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294649:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.294654:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.294658:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294670:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294680:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294686:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294705:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787847516.294717:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847516.294724:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294732:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.294755:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294765:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294782:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294790:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862e88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294809:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.294812:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294818:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.294821:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294828:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294837:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294845:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862e8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.294864:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.294866:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.294868:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.295310:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.295317:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295326:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.295329:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.295334:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295354:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295362:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295369:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295383:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.295391:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.295394:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295411:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.295415:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295423:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295434:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295441:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862e96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295455:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.295456:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.295458:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.295845:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.295852:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295860:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.295863:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.295868:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295876:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295892:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295899:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295913:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.295922:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.295925:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295958:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.295962:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295969:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295980:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.295988:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862e9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.296001:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.296009:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.296010:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787847516.296907:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.306322:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.306353:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.306373:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.306378:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.306385:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307451:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307465:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307472:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307505:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.307517:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.307522:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307529:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.307534:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307556:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307573:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307581:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ea4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.307603:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.307605:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.307607:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.310138:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.310150:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.310166:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.310170:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.310176:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.310189:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.310198:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312213:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312275:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787847516.312834:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.312842:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312854:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.312859:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.312864:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312878:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312886:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312893:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312908:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787847516.312918:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847516.312923:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312964:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.312968:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312977:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.312994:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313002:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862eab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313020:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.313023:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313029:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.313032:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313040:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313049:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313062:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862eb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.313074:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.313075:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.313077:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847516.313510:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.314821:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.314832:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314846:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.314850:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.314856:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314868:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314877:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314886:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314901:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.314912:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.314922:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314945:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.314950:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314960:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314975:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.314983:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.315001:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.315003:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.315005:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.315654:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.315662:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.315673:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.315676:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.315681:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.315704:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.315713:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.315720:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.315732:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787847516.316150:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.316156:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316165:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.316168:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.316172:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316181:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316189:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316208:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316239:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787847516.316251:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847516.316256:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316263:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.316267:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316276:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316289:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316297:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316313:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.316316:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316334:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.316348:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316357:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316368:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316376:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ec7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.316576:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.316578:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.316580:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847516.317086:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.317874:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.317883:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.317898:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.317902:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.317908:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.317919:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.317952:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.317959:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.317976:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.317986:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.317992:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.317999:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.318002:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.318010:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.318024:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.318031:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862ece lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.318050:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.318058:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.318060:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.322209:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.322236:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.322253:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.322258:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.322264:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.322278:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.322288:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.322296:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.322312:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787847516.324494:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.324508:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324524:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.324529:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.324535:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324562:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324573:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324580:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324602:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787847516.324619:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847516.324626:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324633:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afea00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.324637:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324645:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324660:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324668:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e6e1096/0x1835de88b9862ed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324696:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.324700:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324707:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affc00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.324710:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324717:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324727:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.324734:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdfa5c1e/0x1835de88b9862edc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847516.325323:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.325401:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.325404:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.325406:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.327097:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.327109:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.327125:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.327130:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.327141:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.327156:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.327166:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.327175:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.327191:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787847516.327305:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787847516.327312:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847516.327321:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:3.0:1787847516.327325:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847516.327355:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847516.327372:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847516.327379:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006471b2ad/0x1835de88b9862ee3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847516.327400:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847516.327402:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847516.327404:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.331194:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.331208:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.332551:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.332557:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.332565:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.332582:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.332592:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.332612:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.332627:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787847516.332838:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847516.332846:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.332861:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847516.332866:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.332876:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.332893:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.332901:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089445ec0/0x1835de88b9862eea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847516.332925:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847516.332927:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847516.332956:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787847516.333015:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787847516.333572:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.333579:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.333590:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.333594:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.333598:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.333608:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.333616:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.333623:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.333639:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787847516.334122:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.334129:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334144:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.334147:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.334151:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334162:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334170:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334177:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334192:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787847516.334203:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787847516.334208:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334216:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.334220:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334229:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334254:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334262:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f58f/0x1835de88b9862ef1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334279:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.334282:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334290:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe200 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.334293:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334301:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334310:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334318:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029274e54/0x1835de88b9862ef8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334329:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.334331:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.334352:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.334769:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.334776:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334786:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.334790:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.334794:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334804:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334812:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334818:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334832:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.334841:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.334844:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334850:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff600 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.334853:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334873:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334883:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334890:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a4fc162/0x1835de88b9862eff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.334905:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.334907:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.334908:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.335356:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.335363:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335372:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.335376:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.335380:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335389:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335397:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335416:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335433:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.335443:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.335447:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335454:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.335457:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335465:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335477:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335485:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094fa4497/0x1835de88b9862f06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335499:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.335501:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.335502:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.335907:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.335921:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335951:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.335956:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.335960:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335970:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335977:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335984:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.335998:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.336006:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.336010:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.336016:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.336019:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.336027:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.336046:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.336054:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ccbbaca/0x1835de88b9862f0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.336068:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.336070:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.336071:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847516.339497:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787847516.346226:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787847516.346241:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346259:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=431s v=(0 0) 00010000:00010000:0.0:1787847516.346263:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847516.346271:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346287:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346298:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346306:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346346:0:15045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787847516.346359:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787847516.346365:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346373:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff400 already unused, calling callback (ffffffffc1555440) 00010000:00010000:0.0:1787847516.346377:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346386:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346404:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346412:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008d0a3d4/0x1835de88b9862f14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847516.346436:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.346438:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847516.346440:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787847516.346679:0:15045:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787847516.347352:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14383:x1874693616405888:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88270us (89509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847516.347364:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787847516.347430:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1874693616405888:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787847516.347445:0:14383:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787847516.347491:0:14383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1874693616406016:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787847516.347526:0:14383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847516.347560:0:14383:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddd600 going to sleep for 11 seconds 00000100:00100000:0.0:1787847516.347579:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406016 00000100:00100000:0.0:1787847516.347585:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406016 00000100:00100000:0.0:1787847516.347621:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787847516.347630:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14383:x1874693616406016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787847516.347666:0:15573:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787847516.367651:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14383:x1874693616406016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20012us (20114us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787847516.367665:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787847516.368046:0:14383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14383:1874693616406016:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787847516.368065:0:14383:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1787847516.759317:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847516.759689:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616406144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787847516.759774:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847516.759965:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406144 00000100:00100000:3.0:1787847516.759974:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406144 00000100:00100000:3.0:1787847516.760021:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847516.760030:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616406144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847516.760059:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847516.760104:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616406144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847516.760112:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847516.760155:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d88007ada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616406144:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787847517.350814:0:16118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg121-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787847517.785918:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847518.808413:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847519.438835:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847519.438908:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595438720 00000100:00100000:0.0:1787847519.438920:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595438720 00000100:00100000:0.0:1787847519.439065:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:0.0:1787847519.439073:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2343:x1874693595438720:12345-192.168.201.21@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787847519.439103:0:14352:0:(ldlm_lib.c:1454:target_handle_connect()) MGS: connection from dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c@192.168.201.21@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1787847519.439134:0:14352:0:(genops.c:1385:class_connect()) connect: client dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c, cookie 0x1835de88b9862f1b 00000100:00080000:0.0:1787847519.439489:0:14352:0:(import.c:65:import_set_state_nolock()) ffff8d87ef01e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787847519.439613:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+5:2343:x1874693595438720:12345-192.168.201.21@tcp:250:mount.lustre.0 Request processed in 538us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847519.439621:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 74 00000100:00100000:1.0:1787847519.445738:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847519.445870:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595438848 00000100:00100000:3.0:1787847519.445893:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595438848 00000100:00100000:3.0:1787847519.445960:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:3.0:1787847519.445968:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+5:13722:x1874693595438848:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787847519.445982:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847519.445996:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9862f22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fdb expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847519.446018:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9862f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fdb expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847519.446026:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b7e00/0x1835de88b9862f22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fdb expref: 6 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847519.446033:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7e00, rc 0) 00000100:00100000:3.0:1787847519.446073:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+6:13722:x1874693595438848:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 106us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847519.446078:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 75 00000100:00100000:2.0:1787847519.460054:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847519.464685:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595438976 00000100:00100000:0.0:1787847519.464703:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595438976 00000100:00100000:0.0:1787847519.464768:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:0.0:1787847519.464779:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+6:13722:x1874693595438976:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787847519.465216:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+6:13722:x1874693595438976:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 438us (5170us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787847519.465226:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 76 00000100:00100000:3.0:1787847519.474557:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.474622:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439104 00000100:00100000:1.0:1787847519.474634:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439104 00000100:00100000:1.0:1787847519.474693:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:1.0:1787847519.474703:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+6:13722:x1874693595439104:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787847519.474734:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847519.474754:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d8801879000/0x1835de88b9862f29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d0fe2 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847519.474786:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d8801879000/0x1835de88b9862f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fe2 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847519.474797:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d8801879000/0x1835de88b9862f29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d0fe2 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847519.474807:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801879000, rc 0) 00000100:00100000:1.0:1787847519.475032:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+7:13722:x1874693595439104:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 320us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.475040:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 77 00000100:00100000:3.0:1787847519.486755:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.487104:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439232 00000100:00100000:1.0:1787847519.487115:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439232 00000100:00100000:1.0:1787847519.487175:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:1.0:1787847519.487185:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+7:13722:x1874693595439232:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787847519.487800:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13722:x1874693595439232:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 613us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.487808:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 78 00000100:00100000:2.0:1787847519.489885:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.490197:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439360 00000100:00100000:1.0:1787847519.490378:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439360 00000100:00100000:1.0:1787847519.490433:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:1.0:1787847519.490443:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13722:x1874693595439360:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787847519.491501:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13722:x1874693595439360:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 1054us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.491520:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 79 00000100:00100000:3.0:1787847519.510293:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.510406:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439488 00000100:00100000:1.0:1787847519.510422:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439488 00000100:00100000:1.0:1787847519.510484:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:1.0:1787847519.510495:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13740:x1874693595439488:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787847519.510808:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13740:x1874693595439488:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 315us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.510815:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 80 00000100:00100000:3.0:1787847519.521247:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.521410:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439616 00000100:00100000:1.0:1787847519.521421:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439616 00000100:00100000:1.0:1787847519.521479:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:1.0:1787847519.521489:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13740:x1874693595439616:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787847519.522489:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13740:x1874693595439616:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 997us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.522500:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 81 00000100:00100000:2.0:1787847519.531707:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847519.531816:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439744 00000100:00100000:0.0:1787847519.531826:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439744 00000100:00100000:0.0:1787847519.531886:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:0.0:1787847519.531897:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+8:13722:x1874693595439744:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787847519.531915:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847519.531969:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6afea00/0x1835de88b9862f30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d100c expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.531997:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afea00/0x1835de88b9862f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d100c expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.532008:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6afea00/0x1835de88b9862f30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d100c expref: 9 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.532018:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afea00, rc 0) 00000100:00100000:0.0:1787847519.533307:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+9:13722:x1874693595439744:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 1405us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847519.533318:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 82 00000100:00100000:0.0:1787847519.544378:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847519.544465:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595439872 00000100:00100000:3.0:1787847519.544476:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595439872 00000100:00100000:3.0:1787847519.544534:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:3.0:1787847519.544545:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+9:13722:x1874693595439872:12345-192.168.201.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787847519.544572:0:14353:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787847519.544600:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787847519.544604:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787847519.544612:0:14353:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787847519.544615:0:14353:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787847519.550403:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+9:13722:x1874693595439872:12345-192.168.201.21@tcp:256:mount.lustre.0 Request processed in 5850us (6024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847519.550418:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 83 00000100:00100000:2.0:1787847519.558018:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.559537:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440000 00000100:00100000:1.0:1787847519.559552:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440000 00000100:00100000:1.0:1787847519.559628:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:1.0:1787847519.559639:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+9:13722:x1874693595440000:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787847519.559658:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847519.559679:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1013 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847519.559707:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847519.559739:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 10 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847519.559748:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801879200, rc 0) 00000100:00100000:1.0:1787847519.559816:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13722:x1874693595440000:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 178us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.559823:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 84 00000100:00100000:0.0:1787847519.563644:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847519.563731:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440128 00000100:00100000:3.0:1787847519.563740:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440128 00000100:00100000:3.0:1787847519.563794:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:3.0:1787847519.563802:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13722:x1874693595440128:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787847519.564380:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13722:x1874693595440128:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 576us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847519.564390:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 85 00000100:00100000:3.0:1787847519.570124:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847519.570549:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440256 00000100:00100000:2.0:1787847519.570561:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440256 00000100:00100000:2.0:1787847519.570629:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:2.0:1787847519.570640:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13722:x1874693595440256:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787847519.571228:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13722:x1874693595440256:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 586us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847519.571238:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 86 00000100:00100000:3.0:1787847519.576031:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.576262:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440384 00000100:00100000:1.0:1787847519.576272:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440384 00000100:00100000:1.0:1787847519.576338:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:1.0:1787847519.576349:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13744:x1874693595440384:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787847519.576632:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13744:x1874693595440384:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 284us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.576640:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 87 00000100:00100000:2.0:1787847519.589367:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.589467:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440512 00000100:00100000:1.0:1787847519.589477:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440512 00000100:00100000:1.0:1787847519.589537:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:1.0:1787847519.589547:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13744:x1874693595440512:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787847519.589846:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13744:x1874693595440512:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 299us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.589855:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 88 00000100:00100000:0.0:1787847519.614343:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.614695:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440640 00000100:00100000:1.0:1787847519.614707:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440640 00000100:00100000:1.0:1787847519.614762:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1787847519.614770:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2343:x1874693595440640:12345-192.168.201.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787847519.615816:0:14358:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114@192.168.201.21@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1787847519.615874:0:14358:0:(genops.c:1385:class_connect()) connect: client ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114, cookie 0x1835de88b9862f3e 00000004:00100000:1.0:1787847519.615906:0:14358:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1787847519.615912:0:14358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787847519.688074:0:14358:0:(import.c:65:import_set_state_nolock()) ffff8d87ef01e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787847519.688148:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2343:x1874693595440640:12345-192.168.201.21@tcp:38:mount.lustre.0 Request processed in 73376us (73814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847519.688175:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:2.0:1787847519.703612:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847519.703655:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847519.706141:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440896 00000100:00100000:3.0:1787847519.706156:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440896 00000100:00100000:0.0:1787847519.708853:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595440768 00000100:00100000:0.0:1787847519.708869:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595440768 00000100:00100000:0.0:1787847519.708977:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:0.0:1787847519.708989:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:0:x1874693595440768:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787847519.709037:0:14359:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787847519.709159:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:0:x1874693595440768:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 171us (5502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847519.709168:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00080000:3.0:1787847519.713915:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847519.714105:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1787847519.714132:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13722:x1874693595440896:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787847519.714165:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787847519.714346:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13722:x1874693595440896:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 217us (10742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847519.714355:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:2.0:1787847519.719888:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.720059:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441024 00000100:00100000:1.0:1787847519.720069:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441024 00000100:00100000:1.0:1787847519.720128:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1787847519.720138:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88003692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13722:x1874693595441024:12345-192.168.201.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787847519.720246:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88003692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13722:x1874693595441024:12345-192.168.201.21@tcp:40:mount.lustre.0 Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.720253:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1787847519.723613:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.723656:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847519.723703:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847519.723752:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441152 00000100:00100000:0.0:1787847519.723761:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441152 00000100:00100000:3.0:1787847519.723790:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441408 00000100:00100000:3.0:1787847519.723796:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441408 00000100:00100000:0.0:1787847519.723846:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441280 00000100:00100000:3.0:1787847519.723850:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1787847519.723852:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441280 00000100:00100000:3.0:1787847519.723866:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13722:x1874693595441408:12345-192.168.201.21@tcp:33:mount.lustre.0 00000100:00100000:1.0:1787847519.723885:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1787847519.723893:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2343:x1874693595441152:12345-192.168.201.21@tcp:8:mount.lustre.0 00000100:00100000:2.0:1787847519.723915:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1787847519.723923:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2343:x1874693595441280:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787847519.723927:0:15045:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114@192.168.201.21@tcp t0 exp 0000000000000000 cur 434 last 0 00010000:00080000:2.0:1787847519.723968:0:15043:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114@192.168.201.21@tcp t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:1.0:1787847519.723984:0:15045:0:(genops.c:1385:class_connect()) connect: client ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114, cookie 0x1835de88b9862f45 00002000:00100000:1.0:1787847519.723995:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114/ffff8d880051b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:2.0:1787847519.723997:0:15043:0:(genops.c:1385:class_connect()) connect: client ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114, cookie 0x1835de88b9862f4c 00002000:00100000:2.0:1787847519.724007:0:15043:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114/ffff8d87c2bab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787847519.724020:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1787847519.724024:0:15043:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787847519.724555:0:15043:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787847519.724587:0:15043:0:(import.c:65:import_set_state_nolock()) ffff8d87c2baf800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787847519.724699:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2343:x1874693595441280:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 774us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847519.724708:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00002000:00080000:1.0:1787847519.724783:0:15045:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787847519.724804:0:15045:0:(import.c:65:import_set_state_nolock()) ffff8d880051c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847519.724836:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2343:x1874693595441152:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 942us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847519.724854:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000004:00080000:1.0:1787847519.726117:0:14361:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1781us 00000004:00200000:3.0:1787847519.763839:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787847519.764452:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13722:x1874693595441408:12345-192.168.201.21@tcp:33:mount.lustre.0 Request processed in 40583us (40842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847519.764464:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00010000:00010000:0.0:1787847519.831586:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847519.968634:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847519.970735:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441536 00000100:00100000:0.0:1787847519.970748:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441536 00000100:00100000:0.0:1787847519.970867:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:0.0:1787847519.970877:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:13765:x1874693595441536:12345-192.168.201.21@tcp:101:mkdir.0 00010000:00010000:0.0:1787847519.970897:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847519.970920:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9862f53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d103d expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.971005:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862f5a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.971019:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.971050:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847519.971225:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787847519.971229:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847519.971355:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862f5a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.971388:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b9862f53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d103d expref: 8 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.971405:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862f5a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d103d expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847519.971414:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:0.0:1787847519.971417:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787847519.971420:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:0.0:1787847519.971491:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:13765:x1874693595441536:12345-192.168.201.21@tcp:101:mkdir.0 Request processed in 615us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847519.971499:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00010000:00010000:1.0:1787847520.856593:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847521.367243:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847521.367390:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616406272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787847521.367478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847521.367549:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616406656:0@lo:400:kworker.0 00000100:00100000:1.0:1787847521.367574:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847521.367592:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787847521.367599:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616406784:0@lo:400:kworker.0 00000100:00100000:1.0:1787847521.367625:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847521.367658:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406656 00000100:00100000:1.0:1787847521.367666:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406656 00000100:00100000:1.0:1787847521.367725:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847521.367736:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616406656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847521.367788:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616406656:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847521.367795:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787847521.367837:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616406656:0@lo:400:kworker.0 00000100:00100000:2.0:1787847521.367871:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406272 00000100:00100000:2.0:1787847521.367876:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406272 00000100:00100000:1.0:1787847521.367878:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406784 00000100:00100000:1.0:1787847521.367881:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406784 00000100:00100000:2.0:1787847521.367905:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847521.367905:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847521.367911:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616406784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847521.367912:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616406272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847521.367961:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847521.367965:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1874693616406784:12345-0@lo:400:kworker.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847521.367996:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1874693616406272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847521.367998:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787847521.368021:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847521.368025:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1874693616406784:0@lo:400:kworker.0 00000100:00100000:1.0:1787847521.368039:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616406272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847521.368119:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616406528:0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847521.368177:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616407040:0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847521.368238:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787847521.368245:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616406400:0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368283:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847521.368304:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616406912:0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847521.368350:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406528 00000100:00100000:3.0:1787847521.368354:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406528 00000100:00100000:3.0:1787847521.368382:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787847521.368389:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616406528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368428:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616406528:12345-0@lo:400:kworker.0 Request processed in 39us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847521.368434:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787847521.368450:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787847521.368454:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847521.368472:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616406528:0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368488:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407040 00000100:00100000:3.0:1787847521.368492:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407040 00000100:00100000:3.0:1787847521.368515:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406912 00000100:00100000:3.0:1787847521.368518:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406912 00000100:00100000:3.0:1787847521.368533:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787847521.368538:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616407040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368572:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1874693616407040:12345-0@lo:400:kworker.0 Request processed in 33us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847521.368578:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787847521.368589:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787847521.368594:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368620:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1874693616406912:12345-0@lo:400:kworker.0 Request processed in 26us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847521.368633:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787847521.368647:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847521.368664:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1874693616406912:0@lo:400:kworker.0 00000100:00100000:3.0:1787847521.368675:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1874693616407040:0@lo:400:kworker.0 00000100:00100000:2.0:1787847521.369112:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616406400 00000100:00100000:2.0:1787847521.369117:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616406400 00000100:00100000:2.0:1787847521.369161:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787847521.369168:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3301:x1874693616406400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847521.369219:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3301:x1874693616406400:12345-0@lo:400:kworker.0 Request processed in 52us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847521.369225:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787847521.369415:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616406400:0@lo:400:kworker.0 00000001:00080000:0.0:1787847521.537877:0:7632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787847521.537960:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787847521.537968:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114 00010000:00010000:0.0:1787847521.879563:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847521.881754:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616407168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847521.881829:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847521.882111:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407168 00000100:00100000:2.0:1787847521.882118:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407168 00000100:00100000:3.0:1787847521.882212:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787847521.882222:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616407168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847521.882264:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847521.882310:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616407168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847521.882318:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847521.885102:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616407168:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1787847521.961210:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114 00000100:00100000:3.0:1787847521.985353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847521.985540:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441664 00000100:00100000:1.0:1787847521.985559:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441664 00000100:00080000:3.0:1787847521.985780:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787847521.985861:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1787847521.985874:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:13818:x1874693595441664:12345-192.168.201.21@tcp:41:lfs.0 00000004:00000024:1.0:1787847521.985921:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787847521.986043:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ad680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:13818:x1874693595441664:12345-192.168.201.21@tcp:41:lfs.0 Request processed in 172us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847521.989749:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1787847521.992633:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847521.992872:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441792 00000100:00100000:3.0:1787847521.992882:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441792 00000100:00100000:3.0:1787847521.992979:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1787847521.992988:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:13818:x1874693595441792:12345-192.168.201.21@tcp:13:lfs.0 00002000:00000024:3.0:1787847521.993013:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787847521.993093:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:13818:x1874693595441792:12345-192.168.201.21@tcp:13:lfs.0 Request processed in 106us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847521.993101:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00080000:1.0:1787847521.993388:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847521.997024:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847521.997140:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595441920 00000100:00100000:3.0:1787847521.997150:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595441920 00000100:00100000:3.0:1787847521.997218:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847521.997228:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:13818:x1874693595441920:12345-192.168.201.21@tcp:13:lfs.0 00002000:00000024:3.0:1787847521.997281:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787847521.997415:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847521.997476:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:13818:x1874693595441920:12345-192.168.201.21@tcp:13:lfs.0 Request processed in 248us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847521.997484:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847522.185771:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847522.192953:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442048 00000100:00100000:1.0:1787847522.192970:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442048 00000100:00100000:1.0:1787847522.193040:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:1.0:1787847522.193052:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e75c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+10:13848:x1874693595442048:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787847522.193086:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847522.193106:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d8801879600/0x1835de88b9862f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1044 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847522.193135:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d8801879600/0x1835de88b9862f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1044 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847522.193147:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d8801879600/0x1835de88b9862f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1044 expref: 11 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847522.193157:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801879600, rc 0) 00000100:00100000:1.0:1787847522.193284:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e75c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13848:x1874693595442048:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 233us (7522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847522.193291:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 90 00000100:00100000:1.0:1787847522.205339:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.213761:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442176 00000100:00100000:3.0:1787847522.213777:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442176 00000100:00100000:3.0:1787847522.215603:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:3.0:1787847522.215623:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13848:x1874693595442176:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787847522.215970:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13848:x1874693595442176:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 354us (10649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847522.215980:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 91 00000100:00100000:0.0:1787847522.234055:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847522.234220:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442304 00000100:00100000:2.0:1787847522.234231:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442304 00000100:00100000:2.0:1787847522.234303:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:2.0:1787847522.234315:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13848:x1874693595442304:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787847522.234904:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13848:x1874693595442304:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 589us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847522.234914:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 92 00000100:00100000:0.0:1787847522.242121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.242478:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442432 00000100:00100000:3.0:1787847522.242488:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442432 00000100:00100000:3.0:1787847522.242554:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:3.0:1787847522.242566:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13856:x1874693595442432:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787847522.243081:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13856:x1874693595442432:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 516us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847522.243091:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 93 00000100:00100000:1.0:1787847522.302750:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847522.304839:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442560 00000100:00100000:2.0:1787847522.304854:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442560 00000100:00100000:2.0:1787847522.304980:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:2.0:1787847522.304992:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13856:x1874693595442560:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787847522.305309:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13856:x1874693595442560:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 318us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847522.305317:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 94 00000100:00100000:0.0:1787847522.314800:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847522.314886:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442688 00000100:00100000:1.0:1787847522.314896:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442688 00000100:00100000:1.0:1787847522.315003:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:1.0:1787847522.315014:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13848:x1874693595442688:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787847522.315031:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847522.315049:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d8801878600/0x1835de88b9862f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d106e expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847522.315079:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d8801878600/0x1835de88b9862f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d106e expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847522.315092:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d8801878600/0x1835de88b9862f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d106e expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847522.315109:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801878600, rc 0) 00000100:00100000:1.0:1787847522.315180:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13848:x1874693595442688:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 168us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847522.315187:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 95 00000100:00100000:0.0:1787847522.330907:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847522.331116:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442816 00000100:00100000:2.0:1787847522.331142:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442816 00000100:00100000:2.0:1787847522.331208:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:2.0:1787847522.331219:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d0631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13848:x1874693595442816:12345-192.168.201.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787847522.331255:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787847522.331272:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787847522.331277:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787847522.331280:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787847522.331282:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787847522.336047:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d0631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13848:x1874693595442816:12345-192.168.201.21@tcp:256:mount.lustre.0 Request processed in 4817us (5137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847522.336064:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 96 00000100:00100000:0.0:1787847522.344753:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.345384:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595442944 00000100:00100000:3.0:1787847522.345396:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595442944 00000100:00100000:3.0:1787847522.345523:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:3.0:1787847522.345534:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13848:x1874693595442944:12345-192.168.201.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787847522.345552:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847522.345582:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1075 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.345629:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.345652:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.345662:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6600, rc 0) 00000100:00100000:3.0:1787847522.345729:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13848:x1874693595442944:12345-192.168.201.21@tcp:101:mount.lustre.0 Request processed in 196us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847522.345736:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 97 00000100:00100000:3.0:1787847522.355102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847522.357537:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443072 00000100:00100000:0.0:1787847522.357553:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443072 00000100:00100000:0.0:1787847522.357634:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:0.0:1787847522.357655:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13848:x1874693595443072:12345-192.168.201.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787847522.357983:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13848:x1874693595443072:12345-192.168.201.21@tcp:501:mount.lustre.0 Request processed in 330us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847522.357991:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 98 00000100:00100000:2.0:1787847522.364688:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.364872:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443200 00000100:00100000:3.0:1787847522.364882:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443200 00000100:00100000:3.0:1787847522.364976:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:3.0:1787847522.364987:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13848:x1874693595443200:12345-192.168.201.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787847522.365216:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13848:x1874693595443200:12345-192.168.201.21@tcp:503:mount.lustre.0 Request processed in 230us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847522.365225:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 99 00000100:00100000:2.0:1787847522.373308:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847522.374711:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443328 00000100:00100000:1.0:1787847522.374723:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443328 00000100:00100000:1.0:1787847522.374795:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:1.0:1787847522.374806:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13861:x1874693595443328:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787847522.375102:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13861:x1874693595443328:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 297us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847522.375110:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 100 00000100:00100000:1.0:1787847522.385526:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847522.385634:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443456 00000100:00100000:0.0:1787847522.385644:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443456 00000100:00100000:0.0:1787847522.385703:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:0.0:1787847522.385714:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13861:x1874693595443456:12345-192.168.201.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787847522.386019:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13861:x1874693595443456:12345-192.168.201.21@tcp:502:llog_process_th.0 Request processed in 306us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847522.386027:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 101 00000100:00100000:2.0:1787847522.407323:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847522.408017:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443584 00000100:00100000:1.0:1787847522.408029:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443584 00000100:00100000:1.0:1787847522.408086:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1787847522.408095:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2343:x1874693595443584:12345-192.168.201.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787847522.408125:0:14359:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-MDT0000: connection from d4971f63-4888-4fa1-9431-68a53bc776d7@192.168.201.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787847522.408161:0:14359:0:(genops.c:1385:class_connect()) connect: client d4971f63-4888-4fa1-9431-68a53bc776d7, cookie 0x1835de88b9862f76 00000004:00100000:1.0:1787847522.408194:0:14359:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787847522.408330:0:14359:0:(import.c:65:import_set_state_nolock()) ffff8d880051b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847522.408407:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2343:x1874693595443584:12345-192.168.201.21@tcp:38:mount.lustre.0 Request processed in 311us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847522.408479:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:2.0:1787847522.434036:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847522.434211:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443712 00000100:00100000:0.0:1787847522.434221:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443712 00000100:00100000:0.0:1787847522.434308:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:0.0:1787847522.434320:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+6:0:x1874693595443712:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787847522.434365:0:14360:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787847522.434447:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+6:0:x1874693595443712:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 129us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847522.434472:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00080000:1.0:1787847522.434595:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787847522.435471:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847522.435557:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443840 00000100:00100000:2.0:1787847522.435564:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443840 00000100:00100000:2.0:1787847522.435614:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:2.0:1787847522.435622:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13848:x1874693595443840:12345-192.168.201.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787847522.435653:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787847522.435710:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13848:x1874693595443840:12345-192.168.201.21@tcp:41:mount.lustre.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847522.435718:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1787847522.445202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847522.445324:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595443968 00000100:00100000:2.0:1787847522.445333:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595443968 00000100:00100000:2.0:1787847522.445394:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1787847522.445405:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13848:x1874693595443968:12345-192.168.201.21@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787847522.445496:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007aed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13848:x1874693595443968:12345-192.168.201.21@tcp:40:mount.lustre.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847522.445503:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1787847522.447486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.447517:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.447553:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847522.447650:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444096 00000100:00100000:1.0:1787847522.447660:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444096 00000100:00100000:1.0:1787847522.447694:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444224 00000100:00100000:1.0:1787847522.447696:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444224 00000100:00100000:1.0:1787847522.447711:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1787847522.447718:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874693595444096:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787847522.447746:0:15042:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0000: connection from d4971f63-4888-4fa1-9431-68a53bc776d7@192.168.201.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787847522.447778:0:15042:0:(genops.c:1385:class_connect()) connect: client d4971f63-4888-4fa1-9431-68a53bc776d7, cookie 0x1835de88b9862f7d 00002000:00100000:1.0:1787847522.447790:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d4971f63-4888-4fa1-9431-68a53bc776d7/ffff8d880051d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787847522.447801:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787847522.448053:0:15042:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787847522.448082:0:15042:0:(import.c:65:import_set_state_nolock()) ffff8d880051c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847522.448142:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ad2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2343:x1874693595444096:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 422us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847522.448150:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1787847522.448167:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:1.0:1787847522.448172:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2343:x1874693595444224:12345-192.168.201.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787847522.448187:0:15042:0:(ldlm_lib.c:1454:target_handle_connect()) lustre-OST0001: connection from d4971f63-4888-4fa1-9431-68a53bc776d7@192.168.201.21@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787847522.448203:0:15042:0:(genops.c:1385:class_connect()) connect: client d4971f63-4888-4fa1-9431-68a53bc776d7, cookie 0x1835de88b9862f84 00002000:00100000:1.0:1787847522.448208:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d4971f63-4888-4fa1-9431-68a53bc776d7/ffff8d880051a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113957 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787847522.448214:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787847522.448357:0:15042:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787847522.448371:0:15042:0:(import.c:65:import_set_state_nolock()) ffff8d880051a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787847522.448396:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2343:x1874693595444224:12345-192.168.201.21@tcp:8:mount.lustre.0 Request processed in 222us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847522.448419:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1787847522.452524:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444352 00000100:00100000:2.0:1787847522.452542:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444352 00000100:00100000:2.0:1787847522.452728:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:2.0:1787847522.452739:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13848:x1874693595444352:12345-192.168.201.21@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787847522.452998:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787847522.453157:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13848:x1874693595444352:12345-192.168.201.21@tcp:33:mount.lustre.0 Request processed in 420us (5603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847522.453166:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:0.0:1787847522.725290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847522.725369:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444480 00000100:00100000:3.0:1787847522.725379:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444480 00000100:00100000:3.0:1787847522.725439:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1787847522.725466:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+6:13882:x1874693595444480:12345-192.168.201.21@tcp:101:mkdir.0 00010000:00010000:3.0:1787847522.725488:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847522.725514:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9862f8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d109f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.725594:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.725611:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.725627:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847522.725852:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787847522.725857:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847522.725981:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.726011:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9862f8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.726028:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847522.726037:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:3.0:1787847522.726040:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847522.726044:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7a00, rc 0) 00000100:00100000:3.0:1787847522.726113:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+7:13882:x1874693595444480:12345-192.168.201.21@tcp:101:mkdir.0 Request processed in 651us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847522.726131:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00010000:00010000:1.0:1787847522.903301:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787847523.288291:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787847523.928331:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847524.951287:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787847525.001715:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114 00000001:00100000:1.0:1787847525.001731:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d4971f63-4888-4fa1-9431-68a53bc776d7 00000001:02000400:2.0:1787847525.838324:0:16323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787847525.977093:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787847526.487640:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d674ef9-f2fc-448e-8206-e13ebe069dba:3303:1874693616407296:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.487771:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.487844:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616407808:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.487873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.487906:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787847526.487912:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616407680:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.487955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.487978:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616407424:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.488021:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616407936:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.488056:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847526.488061:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616407552:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.488105:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407808 00000100:00100000:0.0:1787847526.488114:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407808 00000100:00100000:0.0:1787847526.488179:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407680 00000100:00100000:0.0:1787847526.488182:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407680 00000100:00100000:0.0:1787847526.488194:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407936 00000100:00100000:0.0:1787847526.488196:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407936 00000100:00100000:0.0:1787847526.488210:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787847526.488237:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616407808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488294:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874693616407808:12345-0@lo:400:kworker.0 Request processed in 59us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847526.488302:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787847526.488319:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787847526.488324:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616407680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488345:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874693616407680:12345-0@lo:400:kworker.0 Request processed in 21us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847526.488350:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787847526.488359:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787847526.488364:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616407936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488384:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800517840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1874693616407936:12345-0@lo:400:kworker.0 Request processed in 21us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847526.488390:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787847526.488408:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407424 00000100:00100000:0.0:1787847526.488411:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407424 00000100:00100000:0.0:1787847526.488433:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407552 00000100:00100000:0.0:1787847526.488435:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407552 00000100:00100000:0.0:1787847526.488451:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787847526.488457:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616407424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488484:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616407424:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847526.488489:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787847526.488498:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787847526.488502:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616407552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488522:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616407552:12345-0@lo:400:kworker.0 Request processed in 20us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847526.488536:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787847526.488559:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847526.488563:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847526.488566:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847526.488594:0:3300:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787847526.488614:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616407552:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488624:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616407424:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488633:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1874693616407936:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488660:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12be1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874693616407680:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.488669:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1874693616407808:0@lo:400:kworker.0 00000100:00100000:3.0:1787847526.488885:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616407296 00000100:00100000:3.0:1787847526.488890:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616407296 00000100:00100000:3.0:1787847526.488952:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787847526.488961:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3303:x1874693616407296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787847526.489006:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3303:x1874693616407296:12345-0@lo:400:kworker.0 Request processed in 47us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847526.489013:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787847526.489239:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d674ef9-f2fc-448e-8206-e13ebe069dba:3303:1874693616407296:0@lo:400:kworker.0 00000100:00100000:0.0:1787847526.490303:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847526.490320:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616408064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847526.490378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847526.490444:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616408064 00000100:00100000:0.0:1787847526.490451:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616408064 00000100:00100000:0.0:1787847526.490497:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787847526.490505:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616408064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847526.490541:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847526.490581:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616408064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847526.490588:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787847526.490629:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800514000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616408064:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787847526.579678:0:7632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d4971f63-4888-4fa1-9431-68a53bc776d7 00000100:00100000:1.0:1787847526.999539:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616408192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847526.999644:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847526.999754:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616408192 00000100:00100000:1.0:1787847526.999762:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616408192 00000100:00100000:1.0:1787847526.999820:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847526.999828:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616408192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847526.999877:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847526.999963:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1874693616408192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847526.999971:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787847527.000032:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1874693616408192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787847527.000084:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787847527.162846:0:6706:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d4971f63-4888-4fa1-9431-68a53bc776d7 00000100:00100000:3.0:1787847527.855598:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855641:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855671:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855741:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855766:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847527.855807:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444736 00000100:00100000:3.0:1787847527.855818:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444736 00000100:00100000:3.0:1787847527.855893:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445120 00000100:00100000:3.0:1787847527.855896:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445120 00000100:00100000:3.0:1787847527.855916:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1787847527.855927:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2345:x1874693595444736:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847527.856040:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2345:x1874693595444736:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 115us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847527.856049:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1787847527.856067:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1787847527.856073:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2345:x1874693595445120:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847527.856120:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2345:x1874693595445120:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847527.856127:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1787847527.856157:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444992 00000100:00100000:3.0:1787847527.856160:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444992 00000100:00100000:3.0:1787847527.856394:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445248 00000100:00100000:3.0:1787847527.856400:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445248 00000100:00100000:3.0:1787847527.856423:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444864 00000100:00100000:3.0:1787847527.856426:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444864 00000100:00100000:3.0:1787847527.856437:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445376 00000100:00100000:3.0:1787847527.856440:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445376 00000100:00100000:3.0:1787847527.856454:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1787847527.856460:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2345:x1874693595444992:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847527.856487:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2345:x1874693595444992:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847527.856494:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1787847527.856505:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847527.856510:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2345:x1874693595445248:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847527.856531:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2345:x1874693595445248:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 21us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847527.856590:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:3.0:1787847527.856603:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1787847527.856610:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2345:x1874693595444864:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847527.856632:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12be1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2345:x1874693595444864:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 24us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847527.856649:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1787847527.856755:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1787847527.856765:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2345:x1874693595445376:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847527.856792:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2345:x1874693595445376:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 30us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847527.856799:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1787847527.857651:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595444608 00000100:00100000:3.0:1787847527.857725:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595444608 00000100:00100000:3.0:1787847527.857775:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00100000:3.0:1787847527.857783:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2345:x1874693595444608:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:3.0:1787847527.857823:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2345:x1874693595444608:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 41us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847527.857830:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 103 00000100:00080000:0.0:1787847527.858338:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847527.858345:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787847527.858348:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787847528.023293:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847529.047073:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787847529.618602:0:16472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee87b3bb0 20000000:00000080:1.0:1787847529.618621:0:16472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d87ff3f6000 uarg=0000000000000000 20000000:01000000:1.0:1787847529.618657:0:16472:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787847529.618662:0:16472:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787847529.618667:0:16472:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787847529.619738:0:16473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787847529.619988:0:16472:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787847529.633288:0:16472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787847529.633521:0:16472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633542:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633550:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633557:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862e11 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633568:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633575:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633583:0:16472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633629:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 12 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633646:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 12 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.633679:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800516d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408320:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847529.633800:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 12 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633811:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 12 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.633832:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408448:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847529.633869:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862e11 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.633877:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862e11 expref: 18 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.633887:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408576:0@lo:104: 00000100:00100000:0.0:1787847529.633927:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787847529.635472:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.635486:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 18 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.635498:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408704:0@lo:104: 00000100:00100000:0.0:1787847529.635559:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787847529.635582:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.635590:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.635607:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408832:0@lo:104: 00000100:00100000:0.0:1787847529.635633:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847529.635645:0:16472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c7d71900 going to sleep for 11 seconds 00000100:00100000:1.0:1787847529.637274:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787847529.637297:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616408576 00000100:00100000:1.0:1787847529.637305:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616408576 00000100:00100000:1.0:1787847529.637350:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616408704 00000100:00100000:1.0:1787847529.637354:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616408704 00000100:00100000:1.0:1787847529.637364:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616408832 00000100:00100000:1.0:1787847529.637366:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616408832 00000100:00100000:1.0:1787847529.637379:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847529.637387:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+5:16472:x1874693616408576:12345-0@lo:104: 00010000:00010000:1.0:1787847529.637404:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.637487:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787847529.637493:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+5:16472:x1874693616408576:12345-0@lo:104: Request processed in 107us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847529.637500:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787847529.637518:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847529.637524:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+4:16472:x1874693616408704:12345-0@lo:104: 00010000:00010000:1.0:1787847529.637532:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.637568:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787847529.637584:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+4:16472:x1874693616408704:12345-0@lo:104: Request processed in 60us (2024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847529.637590:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787847529.637603:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787847529.637609:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:16472:x1874693616408832:12345-0@lo:104: 00010000:00010000:1.0:1787847529.637616:0:14343:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.637644:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787847529.637650:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9dd9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+3:16472:x1874693616408832:12345-0@lo:104: Request processed in 42us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847529.637655:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787847529.637699:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787847529.637705:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.637713:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6200 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847529.637717:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.637726:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847529.637733:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847529.637738:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787847529.637773:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.637789:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787847529.637810:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847529.638022:0:14347:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787847529.638087:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b6200/0x1835de88b9862e11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862e18 expref: -99 pid: 15762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.638102:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847529.638117:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.638122:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afee00 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:1.0:1787847529.638126:0:14348:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.638133:0:14348:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787847529.638139:0:14348:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787847529.638145:0:14348:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787847529.638285:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408576:0@lo:104: 00000100:00100000:0.0:1787847529.638296:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408704:0@lo:104: 00000100:00100000:0.0:1787847529.638304:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408832:0@lo:104: 00000100:00100000:0.0:1787847529.638351:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d674ef9-f2fc-448e-8206-e13ebe069dba:3303:1874693616408960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787847529.638389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847529.638531:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616408960 00000100:00100000:3.0:1787847529.638537:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616408960 00010000:00010000:3.0:1787847529.638561:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862e11 expref: 19 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847529.638592:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847529.638599:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3303:x1874693616408960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787847529.638611:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847529.638618:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862e11 expref: 19 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847529.638628:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862e11 expref: 19 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847529.638647:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b7000/0x1835de88b9862e18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862e11 expref: 19 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847529.638662:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847529.638707:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:3303:x1874693616408960:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847529.638714:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787847529.638742:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1d674ef9-f2fc-448e-8206-e13ebe069dba:3303:1874693616408960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847529.638979:0:14348:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.638987:0:14348:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847529.639009:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.639015:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c6afee00/0x1835de88b9862c89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862c90 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.639026:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847529.639029:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847529.639030:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847529.639085:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787847529.639097:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616409088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847529.639139:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847529.639321:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409088 00000100:00100000:0.0:1787847529.639326:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409088 00010000:00010000:0.0:1787847529.639344:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.639373:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787847529.639388:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:3301:x1874693616409088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847529.639397:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847529.639401:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.639409:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.639421:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6800/0x1835de88b9862c90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862c89 expref: 18 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.639431:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847529.639593:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:3301:x1874693616409088:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847529.639600:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787847529.640007:0:16474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847529.640010:0:16474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787847529.640012:0:16474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847529.640055:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640063:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff000 already unused, calling callback (ffffffffc1b62c20) 10000000:00010000:0.0:1787847529.640067:0:14347:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640076:0:14347:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787847529.640082:0:14347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787847529.640088:0:14347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787847529.640130:0:14347:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640143:0:14347:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787847529.640172:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640179:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.121@tcp lock: ffff8d87c6aff000/0x1835de88b9862cd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1835de88b9862cdd expref: -99 pid: 15041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640192:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847529.640194:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787847529.640195:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847529.640287:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787847529.640300:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d674ef9-f2fc-448e-8206-e13ebe069dba:3300:1874693616409216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787847529.640340:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847529.640455:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409216 00000100:00100000:0.0:1787847529.640461:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409216 00010000:00010000:0.0:1787847529.640492:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 17 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847529.640522:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787847529.640530:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:3300:x1874693616409216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787847529.640539:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847529.640543:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 17 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640552:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 17 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640563:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c14f5c00/0x1835de88b9862cdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1835de88b9862cd6 expref: 17 pid: 14351 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.640573:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847529.640611:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:3300:x1874693616409216:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847529.640624:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787847529.640723:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1d674ef9-f2fc-448e-8206-e13ebe069dba:3300:1874693616409216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787847529.641093:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1d674ef9-f2fc-448e-8206-e13ebe069dba:3301:1874693616409088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787847529.647552:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800516d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408320:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847529.650664:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1874693616408448:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847529.650713:0:16472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847529.651691:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847529.651740:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847529.654316:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445632 00000100:00100000:1.0:1787847529.654328:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445632 00010000:00010000:1.0:1787847529.654374:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 13 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847529.654416:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445504 00000100:00100000:1.0:1787847529.654433:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445504 00010000:00010000:1.0:1787847529.654446:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 14 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847529.654462:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1787847529.654481:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+14:2346:x1874693595445632:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847529.654496:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847529.654501:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 14 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654611:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 14 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654630:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d8801879200/0x1835de88b9862f37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1013 expref: 14 pid: 14352 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654645:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847529.654723:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2346:x1874693595445632:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 253us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847529.654731:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1787847529.654748:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:1.0:1787847529.654755:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:2346:x1874693595445504:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847529.654762:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847529.654766:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 12 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654774:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 12 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654793:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87ef8b6600/0x1835de88b9862f6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1075 expref: 12 pid: 14353 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654805:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654885:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654902:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654909:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654916:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654923:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.654967:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847529.654972:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.655046:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.655065:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847529.655085:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847529.655653:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:2346:x1874693595445504:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 351us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847529.655661:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00010000:00010000:0.0:1787847529.655756:0:16472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.655765:0:16472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847529.655771:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d87c6afec00/0x1835de88b9862f99 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847530.071618:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847530.743299:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847530.743378:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445760 00000100:00100000:2.0:1787847530.743395:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445760 00000100:00100000:2.0:1787847530.743466:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:2.0:1787847530.743478:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+11:13736:x1874693595445760:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847530.743496:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847530.743517:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c165de00/0x1835de88b9862fa0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10a6 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.743547:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c165de00/0x1835de88b9862fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10a6 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.743560:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c165de00/0x1835de88b9862fa0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10a6 expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.743569:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165de00, rc 0) 00000100:00100000:2.0:1787847530.743709:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13736:x1874693595445760:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 232us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.743729:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 104 00000100:00100000:3.0:1787847530.755652:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847530.757111:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595445888 00000100:00100000:0.0:1787847530.757206:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595445888 00000100:00100000:0.0:1787847530.757334:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:0.0:1787847530.757346:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13736:x1874693595445888:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847530.757655:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13736:x1874693595445888:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 309us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847530.757664:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 105 00000100:00100000:3.0:1787847530.759906:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847530.774055:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446016 00000100:00100000:2.0:1787847530.774584:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446016 00000100:00100000:3.0:1787847530.774995:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 106 00000100:00100000:3.0:1787847530.775011:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13736:x1874693595446016:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787847530.775269:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13736:x1874693595446016:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 261us (15557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847530.775278:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 106 10000000:01000000:2.0:1787847530.776010:0:14356:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787847530.776017:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d86c18b4000 from 10 10000000:01000000:2.0:1787847530.776022:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787847530.776074:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.776099:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.776111:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847530.776268:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.776346:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847530.776444:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847530.776514:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409344 00000100:00100000:0.0:1787847530.776524:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409344 00000100:00100000:0.0:1787847530.776575:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787847530.776585:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+16:14356:x1874693616409344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847530.776598:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847530.776636:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862fae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862fa7 expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.776664:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862fa7 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.776676:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6aff600/0x1835de88b9862fae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862fa7 expref: 17 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.776686:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff600, rc 0) 00000100:00100000:0.0:1787847530.776761:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:14356:x1874693616409344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847530.776769:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787847530.776865:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787847530.776974:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fae expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.776987:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862fae expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847530.777064:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.777113:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847530.777269:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847530.777711:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409472 00000100:00100000:0.0:1787847530.777719:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409472 00000100:00100000:0.0:1787847530.777757:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787847530.777764:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:14356:x1874693616409472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847530.778540:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:14356:x1874693616409472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 773us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847530.778552:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787847530.778581:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.778824:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.779415:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847530.779476:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddd900 going to sleep for 11 seconds 00000100:00100000:0.0:1787847530.783827:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409600 00000100:00100000:0.0:1787847530.784040:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409600 00000100:00100000:2.0:1787847530.784198:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787847530.784224:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:14356:x1874693616409600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.784530:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:14356:x1874693616409600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (5115us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.784539:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787847530.784648:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787847530.788357:0:16513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787847530.794319:0:14356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787847530.794355:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787847530.794368:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fae expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.794380:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165cc00/0x1835de88b9862fa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fae expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787847530.794545:0:14356:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787847530.794550:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87c72c8000 from 10 10000000:01000000:3.0:1787847530.794562:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787847530.794604:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847530.794666:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:3.0:1787847530.794670:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847530.794683:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847530.794729:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446144 00000100:00100000:1.0:1787847530.794736:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446144 00000100:00100000:1.0:1787847530.794786:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00100000:1.0:1787847530.794795:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f9ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+12:13736:x1874693595446144:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847530.794808:0:14353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847530.794820:0:14353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d8801878e00/0x1835de88b9862fbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10ad expref: -99 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847530.794842:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d8801878e00/0x1835de88b9862fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ad expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847530.794862:0:14353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d8801878e00/0x1835de88b9862fbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ad expref: 13 pid: 14353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847530.794871:0:14353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801878e00, rc 0) 00000100:00100000:1.0:1787847530.794951:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f9ab2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13736:x1874693595446144:12345-192.168.201.21@tcp:101:ll_cfg_requeue.0 Request processed in 156us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847530.794958:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 110 00000100:00100000:3.0:1787847530.797239:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787847530.797316:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847530.797369:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f51b0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787847530.797400:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409728 00000100:00100000:0.0:1787847530.797418:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409728 00000100:00100000:0.0:1787847530.797498:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787847530.797511:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+17:14356:x1874693616409728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847530.797551:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847530.797578:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6afe200/0x1835de88b9862fc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862fb5 expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.797615:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6afe200/0x1835de88b9862fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862fb5 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.797643:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6afe200/0x1835de88b9862fc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862fb5 expref: 18 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.797655:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe200, rc 0) 00000100:00100000:0.0:1787847530.797748:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7220450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616409728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847530.797758:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787847530.797856:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847530.797880:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fc3 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.797903:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862fc3 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847530.798038:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847530.798081:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847530.799587:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847530.799789:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409856 00000100:00100000:2.0:1787847530.799803:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409856 00000100:00100000:2.0:1787847530.799862:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787847530.799873:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87c7223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616409856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.800275:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87c7223c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616409856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.800287:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787847530.800328:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787847530.800404:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847530.800486:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847530.800525:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c73a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787847530.801005:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616409984 00000100:00100000:2.0:1787847530.801014:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616409984 00000100:00100000:2.0:1787847530.801056:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787847530.801067:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616409984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.801464:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616409984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 399us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.801475:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787847530.801655:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616409984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847530.803185:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847530.803650:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446272 00000100:00100000:2.0:1787847530.803659:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446272 00000100:00100000:2.0:1787847530.803711:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 114 00000100:00100000:2.0:1787847530.803721:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13736:x1874693595446272:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.804018:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13736:x1874693595446272:12345-192.168.201.21@tcp:501:ll_cfg_requeue.0 Request processed in 297us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.804027:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 114 00000040:00080000:0.0:1787847530.808481:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787847530.808781:0:14356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787847530.808818:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787847530.808830:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fc3 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.808843:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87ef8b7000/0x1835de88b9862fb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fc3 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787847530.808855:0:14356:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787847530.808858:0:14356:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d87e6e62000 from 10 10000000:01000000:2.0:1787847530.808861:0:14356:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787847530.808898:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.808907:0:14356:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847530.808919:0:14356:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847530.808989:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616410112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.809055:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847530.809108:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0ddd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787847530.809765:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410112 00000100:00100000:0.0:1787847530.809781:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410112 00000100:00100000:0.0:1787847530.812322:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787847530.812352:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+18:14356:x1874693616410112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787847530.812377:0:14352:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847530.812404:0:14352:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d87c6affc00/0x1835de88b9862fd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1835de88b9862fca expref: -99 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.812443:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d87c6affc00/0x1835de88b9862fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1835de88b9862fca expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.812459:0:14352:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d87c6affc00/0x1835de88b9862fd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1835de88b9862fca expref: 19 pid: 14352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847530.812470:0:14352:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affc00, rc 0) 00000100:00100000:0.0:1787847530.812587:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616410112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (3530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847530.812594:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787847530.812873:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800368f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616410112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787847530.812919:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fd1 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847530.812957:0:14356:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1835de88b9862fd1 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847530.813058:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616410240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847530.813149:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847530.813208:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746300 going to sleep for 11 seconds 00000100:00100000:2.0:1787847530.813446:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410240 00000100:00100000:2.0:1787847530.813453:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410240 00000100:00100000:2.0:1787847530.813518:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787847530.813528:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616410240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.813820:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616410240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.813828:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787847530.814148:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616410240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787847530.814186:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616410368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787847530.814232:0:14356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847530.814269:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746300 going to sleep for 11 seconds 00000100:00100000:2.0:1787847530.814458:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410368 00000100:00100000:2.0:1787847530.814463:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410368 00000100:00100000:2.0:1787847530.814567:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1787847530.814579:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616410368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787847530.814807:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:14356:x1874693616410368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847530.814815:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787847530.815170:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efbc4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1d674ef9-f2fc-448e-8206-e13ebe069dba:14356:1874693616410368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787847530.816644:0:16519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787847530.816709:0:14356:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787847530.816728:0:14356:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787847530.816740:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fd1 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847530.816752:0:14356:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.121@tcp lock: ffff8d87c165c400/0x1835de88b9862fca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1835de88b9862fd1 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847530.827145:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847530.827400:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446400 00000100:00100000:0.0:1787847530.827419:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446400 00000100:00100000:0.0:1787847530.827500:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 118 00000100:00100000:0.0:1787847530.827513:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13736:x1874693595446400:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787847530.827999:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:13736:x1874693595446400:12345-192.168.201.21@tcp:503:ll_cfg_requeue.0 Request processed in 486us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847530.828009:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 118 00010000:00010000:3.0:1787847531.096156:0:16474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847531.609576:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787847531.609610:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787847531.609673:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847531.609734:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410496 00000100:00100000:2.0:1787847531.609742:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410496 00000100:00100000:2.0:1787847531.609813:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787847531.609821:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616410496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787847531.610194:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787847531.610246:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616410496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 425us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847531.610254:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787847531.610276:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787847531.610315:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616410496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787847531.612115:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616411008:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847531.612213:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787847531.612219:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616410624:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612245:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847531.612273:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616411136:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847531.612323:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616410752:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847531.612367:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787847531.612372:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616410880:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847531.612425:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616411008 00000100:00100000:0.0:1787847531.612431:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616411008 00000100:00100000:0.0:1787847531.612487:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616411136 00000100:00100000:0.0:1787847531.612491:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616411136 00000100:00100000:0.0:1787847531.612505:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410880 00000100:00100000:0.0:1787847531.612507:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410880 00000100:00100000:0.0:1787847531.612520:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787847531.612528:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616411008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612581:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616411008:12345-0@lo:400:kworker.0 Request processed in 53us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847531.612589:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787847531.612618:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787847531.612625:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616411136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612653:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616411136:12345-0@lo:400:kworker.0 Request processed in 29us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847531.612674:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787847531.612685:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787847531.612691:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616410880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612725:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1874693616410880:12345-0@lo:400:kworker.0 Request processed in 34us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847531.612731:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787847531.612752:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410752 00000100:00100000:0.0:1787847531.612756:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410752 00000100:00100000:0.0:1787847531.612926:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787847531.612960:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616410752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.612993:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616410752:12345-0@lo:400:kworker.0 Request processed in 36us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847531.612999:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1787847531.613021:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787847531.613025:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847531.613051:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1874693616410880:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.613061:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616410752:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.613106:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d29e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616411136:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.613117:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616411008:0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.613158:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616410624 00000100:00100000:0.0:1787847531.613161:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616410624 00000100:00100000:0.0:1787847531.613188:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787847531.613195:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3302:x1874693616410624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847531.613229:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3302:x1874693616410624:12345-0@lo:400:kworker.0 Request processed in 35us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847531.613244:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787847531.613281:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616410624:0@lo:400:kworker.0 00000100:00100000:1.0:1787847532.119483:0:3300:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616411264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847532.119559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847532.119860:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616411264 00000100:00100000:3.0:1787847532.119869:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616411264 00000100:00100000:3.0:1787847532.119928:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787847532.119958:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616411264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787847532.119991:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00010000:00010000:0.0:1787847532.120255:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847532.131313:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1874693616411264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11347us (11742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847532.131330:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787847532.137232:0:3300:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d880036b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1874693616411264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787847532.877789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847532.879893:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446528 00000100:00100000:3.0:1787847532.879907:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446528 00000100:00100000:3.0:1787847532.880509:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1787847532.880523:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:14392:x1874693595446528:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847532.880549:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847532.880572:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9862fd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10b4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.880667:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.880682:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.880695:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.880709:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.880716:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.880723:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881685:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862fed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881702:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862fed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881712:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862fed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847532.881818:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787847532.881822:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847532.881918:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862fed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881963:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881970:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881977:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881983:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847532.881988:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.881995:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882008:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:3.0:1787847532.882011:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847532.882015:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882021:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9862fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882059:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882066:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882071:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882082:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847532.882085:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882090:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882099:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d87c3361200) 00010000:00010000:3.0:1787847532.882101:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847532.882104:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882110:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862fe6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882150:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9862fd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10b4 expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882164:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6800/0x1835de88b9862fed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10b4 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.882171:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d87c3361500) 00010000:00010000:3.0:1787847532.882174:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847532.882176:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6800, rc 0) 00000100:00100000:3.0:1787847532.882607:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:14392:x1874693595446528:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2086us (4826us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847532.882616:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00080000:0.0:1787847532.884120:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787847532.894089:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847532.894589:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446784 00000100:00100000:3.0:1787847532.894612:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446784 00000100:00100000:3.0:1787847532.894731:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:3.0:1787847532.894742:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:14392:x1874693595446784:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787847532.894772:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847532.894794:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9862ff4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10bb expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.894867:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.894882:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.894892:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.894905:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.894911:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.894917:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.895766:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6c00/0x1835de88b9863009 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.895781:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6c00/0x1835de88b9863009 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.895790:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6c00/0x1835de88b9863009 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847532.895806:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787847532.896108:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896116:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896124:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896130:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847532.896134:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896142:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896154:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d87c3361500) 00010000:00010000:3.0:1787847532.896157:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847532.896161:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896166:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b9862ffb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896189:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896195:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896777:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896787:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847532.896790:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896797:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896808:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d87c3361200) 00010000:00010000:3.0:1787847532.896810:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847532.896814:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.896819:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863002 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.897589:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9862ff4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10bb expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.897610:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6c00/0x1835de88b9863009 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10bb expref: 9 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.897619:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:3.0:1787847532.897621:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847532.897624:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6c00, rc 0) 00000100:00100000:3.0:1787847532.897706:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14392:x1874693595446784:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 2965us (3625us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787847532.897726:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1787847532.903413:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847532.903819:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595446912 00000100:00100000:3.0:1787847532.903830:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595446912 00000100:00100000:3.0:1787847532.903890:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:3.0:1787847532.903900:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14392:x1874693595446912:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787847532.904437:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14392:x1874693595446912:12345-192.168.201.21@tcp:59:lhsmtool_posix.0 Request processed in 535us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847532.904445:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1787847532.933470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847532.934723:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447040 00000100:00100000:3.0:1787847532.934739:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447040 00000100:00100000:2.0:1787847532.935422:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1787847532.935435:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14398:x1874693595447040:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847532.935667:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847532.935698:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9863017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10c2 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.935923:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.936292:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.936308:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.936326:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.936333:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.936359:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937281:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937293:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937299:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937305:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847532.937310:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937317:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937332:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:2.0:1787847532.937335:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847532.937340:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937346:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986301e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937358:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937364:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937378:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937383:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847532.937386:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937392:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937400:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d87c4d7f700) 00010000:00010000:2.0:1787847532.937402:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847532.937405:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937411:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937515:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9863017 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10c2 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937530:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:2.0:1787847532.937533:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847532.937661:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b9863017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10c2 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.937674:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:2.0:1787847532.937895:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14398:x1874693595447040:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 2461us (4440us total) trans 0 rc 301/301 00000100:00100000:2.0:1787847532.937915:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:0.0:1787847532.948058:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847532.950290:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447168 00000100:00100000:2.0:1787847532.950303:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447168 00000100:00100000:2.0:1787847532.950414:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1787847532.950425:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14398:x1874693595447168:12345-192.168.201.21@tcp:700:lfs.0 00000100:00100000:2.0:1787847532.950543:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14398:x1874693595447168:12345-192.168.201.21@tcp:700:lfs.0 Request processed in 112us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847532.950552:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:3.0:1787847532.954231:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847532.954514:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447424 00000100:00100000:0.0:1787847532.954524:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447424 00000100:00100000:0.0:1787847532.954586:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1787847532.954595:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14398:x1874693595447424:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:0.0:1787847532.954651:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847532.954680:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9862f5a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d103d expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847532.954700:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:0.0:1787847532.954705:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847532.955881:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847532.955903:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 5 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847532.955913:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847532.955991:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 5 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847532.956015:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 5 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847532.956362:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d2b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1874693616411392:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847532.956532:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787847532.960469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847532.960584:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d2b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1874693616411392:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847532.960614:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847532.960898:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447552 00000100:00100000:1.0:1787847532.960905:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447552 00000100:00080000:0.0:1787847532.961037:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787847532.961573:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847532.961615:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:1.0:1787847532.961626:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2347:x1874693595447552:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787847532.961643:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847532.961650:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847532.961663:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847532.961687:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9862f92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d109f expref: 6 pid: 14360 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847532.961703:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:1.0:1787847532.961709:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847532.961717:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847532.961725:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847532.961763:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847532.962283:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.962292:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.962318:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.962328:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.962336:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847532.963131:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2347:x1874693595447552:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 1501us (2671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847532.963150:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000004:00200000:3.0:1787847532.967744:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787847532.967873:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.967898:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.967905:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.967910:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847532.967914:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.967921:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.968293:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c7207200) 00010000:00010000:3.0:1787847532.968297:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847532.968302:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847532.968309:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986302c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787847532.968330:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b250743d reply state 00000000a7315e26 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847532.968339:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847532.968490:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12be580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14398:x1874693595447424:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 13891us (14275us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787847532.968499:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:1.0:1787847532.987505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847532.987560:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847532.987639:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847532.987669:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847532.987713:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447680 00000100:00100000:2.0:1787847532.987723:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447680 00000100:00100000:2.0:1787847532.987804:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:2.0:1787847532.987815:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2347:x1874693595447680:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847532.987890:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2347:x1874693595447680:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847532.987897:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 120 00000100:00100000:0.0:1787847532.990361:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447808 00000100:00100000:0.0:1787847532.990376:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447808 00000100:00100000:0.0:1787847532.990447:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595448064 00000100:00080000:1.0:1787847532.990548:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847532.990580:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595447936 00000100:00100000:1.0:1787847532.990585:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595447936 00000100:00100000:1.0:1787847532.990618:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:1.0:1787847532.990629:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2347:x1874693595447808:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847532.990704:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2347:x1874693595447808:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 76us (3207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847532.990712:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:1.0:1787847532.990730:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:1.0:1787847532.990736:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2347:x1874693595447936:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847532.990975:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2347:x1874693595447936:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 237us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847532.990983:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00080000:1.0:1787847532.990999:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787847532.991358:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847532.991721:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595448192 00000100:00100000:1.0:1787847532.991726:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595448192 00000100:00100000:1.0:1787847532.992417:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:1.0:1787847532.992430:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2347:x1874693595448192:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:1.0:1787847532.992502:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2347:x1874693595448192:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 76us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847532.992523:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00080000:1.0:1787847532.992546:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787847532.993388:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595448064 00000100:00100000:0.0:1787847532.993445:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1787847532.993465:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2347:x1874693595448064:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847532.993508:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2347:x1874693595448064:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 45us (5947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847532.993516:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00080000:1.0:1787847532.993885:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787847532.998434:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.998518:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.998528:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.998657:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847532.998664:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.998691:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.998712:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d87c3361200) 00010000:00010000:2.0:1787847532.998716:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847532.998721:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847532.998728:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863033 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847533.132212:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847533.132669:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595448320 00000100:00100000:2.0:1787847533.132680:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595448320 00000100:00100000:2.0:1787847533.132743:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 20 00000100:00100000:2.0:1787847533.132763:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:14406:x1874693595448320:12345-192.168.201.21@tcp:101:lctl.0 00010000:00010000:2.0:1787847533.132794:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847533.132822:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986303a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10c9 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.132899:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.132913:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.132925:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847533.134693:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787847533.134716:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847533.134784:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.134821:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b986303a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10c9 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.134843:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d200/0x1835de88b9863041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10c9 expref: 10 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.134851:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:2.0:1787847533.134854:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847533.134857:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d200, rc 0) 00000100:00100000:2.0:1787847533.134983:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14406:x1874693595448320:12345-192.168.201.21@tcp:101:lctl.0 Request processed in 2180us (2730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847533.134992:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 20 00010000:00010000:1.0:1787847533.143359:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847533.175063:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.175235:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595448448 00000100:00100000:3.0:1787847533.175244:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595448448 00000100:00100000:3.0:1787847533.175373:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:3.0:1787847533.175381:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+5:14407:x1874693595448448:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847533.175398:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847533.175414:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10d0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.175471:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b986304f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.175485:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b986304f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.175496:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b986304f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847533.175563:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787847533.175567:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847533.175591:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b986304f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.175615:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10d0 expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.175631:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6200/0x1835de88b986304f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10d0 expref: 6 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.175637:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:3.0:1787847533.175640:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787847533.175642:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6200, rc 0) 00000100:00100000:3.0:1787847533.175692:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:14407:x1874693595448448:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 313us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847533.175703:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 21 00000100:00100000:0.0:1787847533.178389:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847533.178444:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595448576 00000100:00100000:2.0:1787847533.178452:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595448576 00000100:00100000:2.0:1787847533.178547:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:2.0:1787847533.178557:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+6:14407:x1874693595448576:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847533.178575:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847533.178593:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10d7 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178647:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178656:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178679:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178689:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178694:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178698:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178799:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b986306b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178806:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b986306b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178812:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b986306b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847533.178845:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787847533.178849:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847533.178872:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b986306b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178882:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178888:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178906:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178913:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847533.178917:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178924:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178966:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:2.0:1787847533.178970:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847533.178974:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178981:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986305d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178993:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.178999:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179004:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179008:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c200 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847533.179010:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179024:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179033:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d87c4d7fe00) 00010000:00010000:2.0:1787847533.179036:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847533.179038:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179054:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b9863064 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179082:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10d7 expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179280:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b986306b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10d7 expref: 7 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.179288:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:2.0:1787847533.179291:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847533.179294:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c600, rc 0) 00000100:00100000:2.0:1787847533.179351:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+7:14407:x1874693595448576:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 795us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847533.179359:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 22 00000100:00100000:1.0:1787847533.189648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.189740:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595448832 00000100:00100000:3.0:1787847533.189749:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595448832 00000100:00100000:3.0:1787847533.189912:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:3.0:1787847533.189925:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+7:14407:x1874693595448832:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847533.189983:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847533.190003:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10de expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847533.190132:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787847533.190250:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863072 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10de expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.190264:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:3.0:1787847533.190267:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847533.190272:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10de expref: 9 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.190286:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6600, rc 0) 00000100:00100000:3.0:1787847533.190341:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+8:14407:x1874693595448832:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 420us (702us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787847533.190348:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 23 00000100:00100000:1.0:1787847533.196821:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.197038:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595449088 00000100:00100000:0.0:1787847533.197057:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595449088 00000100:00100000:0.0:1787847533.197120:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 24 00000100:00100000:0.0:1787847533.197130:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+8:14407:x1874693595449088:12345-192.168.201.21@tcp:36:lfs.0 00010000:00010000:0.0:1787847533.197215:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847533.197245:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b986306b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10d7 expref: 8 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.197273:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c4d7f900) 00010000:00010000:0.0:1787847533.197284:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847533.197311:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.197324:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.197332:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847533.197563:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d7c050a reply state 0000000038a4d08a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847533.197573:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787847533.197586:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787847533.197668:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800514b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d4971f63-4888-4fa1-9431-68a53bc776d7+9:14407:x1874693595449088:12345-192.168.201.21@tcp:36:lfs.0 Request processed in 538us (857us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787847533.197675:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 24 00010000:00010000:3.0:1787847533.200917:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.200956:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.200981:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.200987:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6aff400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847533.200991:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.200999:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.201016:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207000) 00010000:00010000:3.0:1787847533.201019:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787847533.201024:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.201030:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b9863080 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847533.203902:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847533.204047:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595449344 00000100:00100000:2.0:1787847533.204059:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595449344 00000100:00100000:2.0:1787847533.204127:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1787847533.204138:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+8:14407:x1874693595449344:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:2.0:1787847533.204424:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+9:14407:x1874693595449344:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 287us (530us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787847533.204432:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1787847533.213279:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.213495:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595449600 00000100:00100000:3.0:1787847533.213504:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595449600 00000100:00100000:3.0:1787847533.213563:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:3.0:1787847533.213574:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+9:14407:x1874693595449600:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847533.213598:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847533.213619:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863087 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10e5 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.213688:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.213698:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.213718:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.213729:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.213734:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.213738:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847533.213853:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787847533.213965:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214157:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214164:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214232:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847533.214240:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214248:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214260:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:3.0:1787847533.214263:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847533.214275:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214280:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986308e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214293:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214299:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214304:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214309:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847533.214311:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214316:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214323:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d87c3361100) 00010000:00010000:3.0:1787847533.214325:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847533.214328:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214333:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214374:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863087 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10e5 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214396:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:3.0:1787847533.214398:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847533.214402:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863087 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10e5 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.214410:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6600, rc 0) 00000100:00100000:3.0:1787847533.214465:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+10:14407:x1874693595449600:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 892us (1194us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787847533.214472:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:1.0:1787847533.220309:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.220612:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595449728 00000100:00100000:0.0:1787847533.220621:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595449728 00000100:00100000:0.0:1787847533.220671:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:0.0:1787847533.220679:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+10:14407:x1874693595449728:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847533.220700:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847533.220722:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10ec expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.220824:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.220838:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.220849:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.220898:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787847533.220902:0:14359:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847533.220922:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.220968:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.220985:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.220993:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847533.220996:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787847533.220999:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe600, rc 0) 00000100:00100000:1.0:1787847533.226345:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800515680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+11:14407:x1874693595449728:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 5654us (6034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847533.226356:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:1.0:1787847533.230999:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847533.231051:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595449856 00000100:00100000:2.0:1787847533.231061:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595449856 00000100:00100000:2.0:1787847533.231131:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:2.0:1787847533.231142:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+11:14407:x1874693595449856:12345-192.168.201.21@tcp:37:lfs.0 00000100:00100000:2.0:1787847533.236590:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d4971f63-4888-4fa1-9431-68a53bc776d7+11:14407:x1874693595449856:12345-192.168.201.21@tcp:37:lfs.0 Request processed in 5439us (5590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847533.236603:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 3 00000100:00100000:1.0:1787847533.240904:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.241028:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595450112 00000100:00100000:3.0:1787847533.241037:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595450112 00000100:00100000:3.0:1787847533.241101:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:3.0:1787847533.241112:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1b09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+11:14407:x1874693595450112:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847533.241401:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1b09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+12:14407:x1874693595450112:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 289us (502us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787847533.241410:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 4 00000100:00100000:1.0:1787847533.292157:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.292229:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595450240 00000100:00100000:0.0:1787847533.292239:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595450240 00000100:00100000:0.0:1787847533.292300:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:0.0:1787847533.292310:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14413:x1874693595450240:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847533.292330:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847533.292366:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10f3 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292436:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292451:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292462:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292476:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292483:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292490:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292596:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff000/0x1835de88b98630c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292605:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff000/0x1835de88b98630c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292612:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff000/0x1835de88b98630c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.292645:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787847533.292649:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847533.292690:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff000/0x1835de88b98630c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292708:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292715:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292720:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292724:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847533.292728:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292742:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292753:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:0.0:1787847533.292755:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847533.292758:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292762:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292771:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292775:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292783:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292791:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afec00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847533.292793:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292797:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292801:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d87c7207b00) 00010000:00010000:0.0:1787847533.292803:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847533.292805:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292813:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292836:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10f3 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292844:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff000/0x1835de88b98630c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10f3 expref: 11 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.292848:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847533.292850:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787847533.292851:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff000, rc 0) 00000100:00100000:0.0:1787847533.292912:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800516d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+11:14413:x1874693595450240:12345-192.168.201.21@tcp:101:bash.0 Request processed in 603us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847533.292919:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 27 00000100:00100000:1.0:1787847533.296082:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847533.296503:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595450496 00000100:00100000:2.0:1787847533.296513:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595450496 00000100:00100000:2.0:1787847533.296593:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 28 00000100:00100000:2.0:1787847533.296604:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+11:14413:x1874693595450496:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1787847533.296627:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847533.296648:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98630cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d10fa expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.296778:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.296792:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.296801:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.297741:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.297766:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 11 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847533.297780:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1874693616411520:192.168.201.21@tcp:104: 00000100:00100000:2.0:1787847533.298111:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787847533.302821:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d8800369e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1874693616411520:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847533.302864:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847533.304280:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.304664:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595450624 00000100:00100000:3.0:1787847533.304672:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595450624 00010000:00010000:3.0:1787847533.304709:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 12 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847533.304800:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1787847533.304820:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+12:2346:x1874693595450624:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787847533.304837:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847533.304844:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 12 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.304866:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 12 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.304887:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98630aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10ec expref: 12 pid: 14359 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.304902:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:3.0:1787847533.304907:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.304915:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.304923:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847533.304996:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787847533.305055:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+11:2346:x1874693595450624:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 245us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847533.305063:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00010000:00010000:0.0:1787847533.305070:0:14359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.305258:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.305283:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.305293:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.305301:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306191:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306205:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306212:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.306225:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787847533.306254:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306261:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306268:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306274:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847533.306286:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306294:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306306:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847533.306309:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847533.306313:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306318:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98630d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787847533.306331:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8805065 reply state 00000000b8bd9c85 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847533.306339:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787847533.306375:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98630cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306389:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.306396:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847533.306398:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787847533.306400:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afec00, rc 0) 00000100:00100000:0.0:1787847533.306480:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+14:14413:x1874693595450496:12345-192.168.201.21@tcp:101:bash.0 Request processed in 9877us (10408us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787847533.306488:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 28 00010000:00010000:2.0:1787847533.313921:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.313960:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.313969:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.313975:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847533.313981:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.313989:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.314007:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d87c7207b00) 00010000:00010000:2.0:1787847533.314011:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847533.314015:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847533.314052:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98630db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847533.320662:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.320726:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595450752 00000100:00100000:0.0:1787847533.320746:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595450752 00000100:00100000:0.0:1787847533.320909:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:0.0:1787847533.320920:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14413:x1874693595450752:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847533.320992:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847533.321014:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1101 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321603:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321619:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321632:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.321667:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787847533.321670:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847533.321683:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321691:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321709:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1101 expref: 15 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321722:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1101 expref: 14 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.321755:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847533.321757:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847533.321760:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afee00, rc 0) 00000100:00100000:0.0:1787847533.321925:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800369e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+14:14413:x1874693595450752:12345-192.168.201.21@tcp:101:bash.0 Request processed in 1006us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847533.321980:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 29 00000100:00100000:1.0:1787847533.327835:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.327961:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595451008 00000100:00100000:3.0:1787847533.327995:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595451008 00000100:00100000:3.0:1787847533.328071:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:3.0:1787847533.328091:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+14:14413:x1874693595451008:12345-192.168.201.21@tcp:35:bash.0 00000100:00100000:3.0:1787847533.328473:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+15:14413:x1874693595451008:12345-192.168.201.21@tcp:35:bash.0 Request processed in 393us (648us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787847533.328482:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 5 00000100:00100000:2.0:1787847533.490729:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.495304:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595451264 00000100:00100000:0.0:1787847533.495319:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595451264 00000100:00100000:0.0:1787847533.495400:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:0.0:1787847533.495410:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+15:14423:x1874693595451264:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847533.495437:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847533.495459:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1108 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.495596:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787847533.495712:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1108 expref: 17 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.495727:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:0.0:1787847533.495731:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847533.495736:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b98630fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1108 expref: 17 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.495751:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe400, rc 0) 00000100:00100000:0.0:1787847533.496368:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+16:14423:x1874693595451264:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 955us (5646us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787847533.496384:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 30 00000100:00100000:0.0:1787847533.499298:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847533.499405:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595451520 00000100:00100000:3.0:1787847533.499415:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595451520 00000100:00100000:3.0:1787847533.499511:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 6 00000100:00100000:3.0:1787847533.499519:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+16:14423:x1874693595451520:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847533.499743:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14423:x1874693595451520:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 224us (453us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787847533.499748:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 6 00000040:00080000:0.0:1787847533.527725:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787847533.549362:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.549434:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595451776 00000100:00100000:0.0:1787847533.549453:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595451776 00000100:00100000:0.0:1787847533.549506:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:0.0:1787847533.549515:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14426:x1874693595451776:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:0.0:1787847533.549539:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847533.549567:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b986310c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d110f expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.549660:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863113 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.549673:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.549684:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.549694:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787847533.550665:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe400/0x1835de88b986310c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d110f expref: 20 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.550689:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863113 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d110f expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.550698:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847533.550715:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847533.550718:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe800, rc 0) 00000100:00100000:0.0:1787847533.550788:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+19:14426:x1874693595451776:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 1273us (1437us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787847533.550796:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 31 00000100:00100000:2.0:1787847533.554618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.554749:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595451904 00000100:00100000:0.0:1787847533.554760:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595451904 00000100:00100000:0.0:1787847533.554835:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1787847533.554846:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880036ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+19:2346:x1874693595451904:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847533.554862:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847533.554889:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863113 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d110f expref: 19 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.554906:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847533.554912:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847533.554985:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880036ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+18:2346:x1874693595451904:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 141us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847533.554992:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1787847533.559195:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.559350:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595452032 00000100:00100000:0.0:1787847533.559358:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595452032 00000100:00100000:0.0:1787847533.559405:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:0.0:1787847533.559411:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+18:14426:x1874693595452032:12345-192.168.201.21@tcp:54:lfs.0 00010000:00010000:0.0:1787847533.559477:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559490:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559514:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559536:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559541:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559545:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559549:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847533.559552:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559557:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559573:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847533.559575:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787847533.559578:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.559581:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863121 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847533.559639:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+18:14426:x1874693595452032:12345-192.168.201.21@tcp:54:lfs.0 Request processed in 228us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847533.559645:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 32 00000100:00100000:2.0:1787847533.564399:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847533.564538:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595452288 00000100:00100000:1.0:1787847533.564548:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595452288 00000100:00100000:1.0:1787847533.564612:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:1.0:1787847533.564623:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+18:14426:x1874693595452288:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:1.0:1787847533.564895:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+19:14426:x1874693595452288:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 273us (505us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787847533.564904:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 7 00000100:00100000:2.0:1787847533.995407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847533.995719:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595452544 00000100:00100000:0.0:1787847533.995729:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595452544 00000100:00100000:0.0:1787847533.998271:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:0.0:1787847533.998289:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+19:14457:x1874693595452544:12345-192.168.201.21@tcp:101:cat.0 00010000:00010000:0.0:1787847533.998315:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847533.998337:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863128 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1116 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.998544:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986312f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.998617:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986312f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.998630:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986312f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847533.998642:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787847533.999195:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863128 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1116 expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.999217:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986312f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1116 expref: 21 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847533.999226:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847533.999229:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847533.999232:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe800, rc 0) 00000100:00100000:0.0:1787847533.999362:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+21:14457:x1874693595452544:12345-192.168.201.21@tcp:101:cat.0 Request processed in 1078us (3965us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787847533.999391:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 33 00000100:00100000:1.0:1787847534.017707:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847534.017890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847534.018201:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595452928 00000100:00100000:0.0:1787847534.018212:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595452928 00000100:00100000:3.0:1787847534.018290:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595452800 00000100:00100000:3.0:1787847534.018295:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595452800 00000100:00100000:3.0:1787847534.018351:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00100000:3.0:1787847534.018363:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+22:14457:x1874693595452800:12345-192.168.201.21@tcp:35:cat.0 00000100:00100000:0.0:1787847534.018767:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:0.0:1787847534.018775:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+22:2346:x1874693595452928:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847534.018788:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847534.018815:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b986312f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1116 expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.018837:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847534.018842:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847534.018909:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+21:2346:x1874693595452928:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 135us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847534.018918:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 1 00000100:00100000:3.0:1787847534.019745:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+21:14457:x1874693595452800:12345-192.168.201.21@tcp:35:cat.0 Request processed in 1370us (2033us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787847534.019755:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 8 00000100:00080000:1.0:1787847534.028610:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847534.150485:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.150581:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595453184 00000100:00100000:3.0:1787847534.150592:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595453184 00000100:00100000:3.0:1787847534.150663:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:3.0:1787847534.150673:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+21:14463:x1874693595453184:12345-192.168.201.21@tcp:101:dd.0 00010000:00010000:3.0:1787847534.150699:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847534.151178:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b986313d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d111d expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.151299:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863144 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.151313:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.151325:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863144 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847534.151337:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787847534.151544:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b986313d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d111d expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.151580:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863144 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d111d expref: 23 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.151589:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.151592:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847534.151596:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6a00, rc 0) 00000100:00100000:3.0:1787847534.151679:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14463:x1874693595453184:12345-192.168.201.21@tcp:101:dd.0 Request processed in 1006us (1204us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1787847534.151689:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 34 00000100:00100000:2.0:1787847534.156700:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847534.156922:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595453440 00000100:00100000:0.0:1787847534.156970:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595453440 00000100:00100000:0.0:1787847534.157022:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 35 00000100:00100000:0.0:1787847534.157044:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14463:x1874693595453440:12345-192.168.201.21@tcp:36:dd.0 00010000:00010000:0.0:1787847534.157116:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787847534.157142:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863144 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d111d expref: 23 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.157163:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afee00/0x1835de88b98630f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1101 expref: 22 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.157173:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847534.157191:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847534.157447:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.157464:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.157476:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847534.157533:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787847534.157577:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d6289ff reply state 000000004dc31a06 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847534.157587:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787847534.157722:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+24:14463:x1874693595453440:12345-192.168.201.21@tcp:36:dd.0 Request processed in 678us (1030us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787847534.157731:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 35 00000020:00080000:0.0:1787847534.157738:0:14360:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787847534.168234:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168251:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168279:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168286:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847534.168291:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168300:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168317:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.168320:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847534.168325:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168332:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe800/0x1835de88b9863152 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.168559:0:16474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787847534.254550:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.254778:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595453696 00000100:00100000:3.0:1787847534.254789:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595453696 00000100:00100000:3.0:1787847534.254850:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:3.0:1787847534.255034:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14463:x1874693595453696:12345-192.168.201.21@tcp:35:dd.0 00000100:00100000:3.0:1787847534.255304:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+24:14463:x1874693595453696:12345-192.168.201.21@tcp:35:dd.0 Request processed in 282us (763us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787847534.261748:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 9 00000100:00100000:2.0:1787847534.481862:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.482120:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595453824 00000100:00100000:3.0:1787847534.482132:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595453824 00000100:00100000:3.0:1787847534.482202:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:3.0:1787847534.482232:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+24:14477:x1874693595453824:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:3.0:1787847534.482269:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847534.482295:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863159 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1124 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.482373:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.482390:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.482403:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.482418:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.483678:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.483694:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.483804:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.483812:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.483820:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847534.485014:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787847534.485028:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847534.485075:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485089:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485098:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485105:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485113:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485118:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847534.485122:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485129:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485143:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:3.0:1787847534.485146:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847534.485150:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485157:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b9863160 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485184:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485190:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485195:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.485200:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847534.485203:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.486632:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.486648:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d87c3361100) 00010000:00010000:3.0:1787847534.486651:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847534.486656:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.486663:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863167 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.486715:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863159 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1124 expref: 26 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.486729:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1124 expref: 25 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.486753:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.486755:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847534.486758:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6a00, rc 0) 00000100:00100000:3.0:1787847534.486837:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+25:14477:x1874693595453824:12345-192.168.201.21@tcp:101:stat.0 Request processed in 4606us (4986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847534.486846:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 36 00000100:00100000:1.0:1787847534.574187:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.574473:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595454080 00000100:00100000:3.0:1787847534.574483:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595454080 00000100:00100000:3.0:1787847534.574596:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 37 00000100:00100000:3.0:1787847534.574607:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+25:14483:x1874693595454080:12345-192.168.201.21@tcp:36:truncate.0 00010000:00010000:3.0:1787847534.574662:0:14359:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787847534.574688:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986316e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1124 expref: 25 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.574707:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.574712:0:14359:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787847534.574993:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.575007:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.575027:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787847534.575144:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1787847534.575240:0:14359:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025e73b4e reply state 00000000201a10ae transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847534.575262:0:14359:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787847534.575380:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+27:14483:x1874693595454080:12345-192.168.201.21@tcp:36:truncate.0 Request processed in 774us (1202us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787847534.575388:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 37 00000020:00080000:3.0:1787847534.575393:0:14359:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787847534.579749:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.579764:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.579771:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.579777:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b6600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847534.579782:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.579790:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.579818:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847534.579821:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847534.579826:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.579832:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863175 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847534.788522:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.789090:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595454208 00000100:00100000:3.0:1787847534.789101:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595454208 00000100:00100000:3.0:1787847534.789188:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:3.0:1787847534.789199:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+26:14497:x1874693595454208:12345-192.168.201.21@tcp:101:stat.0 00010000:00010000:3.0:1787847534.789238:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847534.789258:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986317c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d112b expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789323:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789336:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789594:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789613:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789620:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789627:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789741:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789750:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789757:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847534.789790:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1787847534.789795:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787847534.789812:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789823:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789831:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789837:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789843:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789848:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847534.789853:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789859:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789877:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:3.0:1787847534.789880:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847534.789885:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.789891:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b9863183 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790775:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790787:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790793:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790799:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7400 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847534.790802:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790808:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790819:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d87c3361100) 00010000:00010000:3.0:1787847534.790822:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847534.790826:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790831:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b986318a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.790885:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b986317c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 28 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.792176:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 27 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.792193:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.792196:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787847534.792199:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6600, rc 0) 00000100:00100000:3.0:1787847534.792287:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+27:14497:x1874693595454208:12345-192.168.201.21@tcp:101:stat.0 Request processed in 3087us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847534.792297:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 38 00000100:00100000:2.0:1787847534.867734:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.870378:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595454464 00000100:00100000:3.0:1787847534.870394:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595454464 00000100:00100000:3.0:1787847534.870461:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:3.0:1787847534.870472:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+27:14507:x1874693595454464:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:3.0:1787847534.870491:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847534.870512:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1132 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847534.870625:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787847534.870745:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863198 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1132 expref: 29 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.870761:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:3.0:1787847534.870764:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787847534.870782:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b9863198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1132 expref: 29 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.870797:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6a00, rc 0) 00000100:00100000:3.0:1787847534.870869:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+28:14507:x1874693595454464:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 399us (3146us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1787847534.870876:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 39 00000100:00100000:2.0:1787847534.873679:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.873768:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595454720 00000100:00100000:3.0:1787847534.873778:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595454720 00000100:00100000:3.0:1787847534.873834:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:3.0:1787847534.873843:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+28:14507:x1874693595454720:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:3.0:1787847534.874131:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1b0bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+29:14507:x1874693595454720:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 287us (460us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787847534.874139:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 10 00000100:00100000:1.0:1787847534.922997:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.923090:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595454976 00000100:00100000:3.0:1787847534.923100:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595454976 00000100:00100000:3.0:1787847534.923152:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:3.0:1787847534.923160:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+29:14513:x1874693595454976:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847534.923186:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847534.923207:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b98631a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1139 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923293:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923303:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 30 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923325:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 30 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923330:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923365:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 30 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923379:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 30 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847534.923393:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1874693616411648:192.168.201.21@tcp:104: 00010000:00010000:3.0:1787847534.923487:0:14358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 30 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.923493:0:14358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 30 pid: 14359 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847534.923499:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d86c1dbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1874693616411776:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847534.923515:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87f9c49600 going to sleep for 11 seconds 00000100:00100000:2.0:1787847534.928452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847534.928494:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847534.928529:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595455232 00000100:00100000:1.0:1787847534.928548:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595455232 00010000:00010000:1.0:1787847534.928585:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 31 pid: 14359 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847534.928618:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595455104 00000100:00100000:1.0:1787847534.928621:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595455104 00010000:00010000:1.0:1787847534.928633:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 32 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847534.928645:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:2.0:1787847534.928656:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88007d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+32:2347:x1874693595455232:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847534.928672:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847534.928679:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 32 pid: 14359 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.928690:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 32 pid: 14359 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847534.928712:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbd680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1874693616411648:192.168.201.21@tcp:104: 00000100:00100000:3.0:1787847534.928721:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d86c1dbe580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14358:1874693616411776:192.168.201.21@tcp:104: 00010000:00010000:2.0:1787847534.928730:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b98630e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d10fa expref: 32 pid: 14359 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.928743:0:14358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.928745:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:2.0:1787847534.928750:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.928758:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.928763:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847534.928807:0:14344:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787847534.928816:0:14344:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787847534.928824:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88007d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+31:2347:x1874693595455232:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 171us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847534.930229:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:1.0:1787847534.930252:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+31:2347:x1874693595455104:12345-192.168.201.21@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1787847534.930263:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00010000:00010000:1.0:1787847534.930269:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787847534.930276:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 31 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847534.930614:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 30 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847534.930637:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6600/0x1835de88b9863191 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d112b expref: 30 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847534.930649:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:1.0:1787847534.930660:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847534.930669:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847534.930677:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847534.931404:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787847534.931618:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+29:2347:x1874693595455104:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 1374us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847534.931629:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00010000:00010000:3.0:1787847534.931757:0:14358:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.931765:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787847534.931785:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787847534.931979:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b98631a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 30 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.931998:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 29 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.932006:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.932009:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787847534.932020:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b7400, rc 0) 00000100:00100000:3.0:1787847534.932048:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+29:14513:x1874693595454976:12345-192.168.201.21@tcp:101:bash.0 Request processed in 8889us (9063us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787847534.932056:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 40 00000100:00100000:2.0:1787847534.935172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847534.935256:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595455488 00000100:00100000:0.0:1787847534.935266:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595455488 00000100:00100000:0.0:1787847534.935359:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 41 00000100:00100000:0.0:1787847534.935367:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+29:14513:x1874693595455488:12345-192.168.201.21@tcp:36:bash.0 00010000:00010000:0.0:1787847534.935682:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.935697:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.935705:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787847534.935743:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787847534.935760:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e028870 reply state 0000000041c6bfc1 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847534.935766:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787847534.935843:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+32:14513:x1874693595455488:12345-192.168.201.21@tcp:36:bash.0 Request processed in 476us (679us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787847534.935866:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 41 00000020:00080000:0.0:1787847534.935870:0:14360:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787847534.937182:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.937195:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.937201:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.937206:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847534.937221:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.937229:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.937244:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.937247:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847534.937251:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.937257:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b98631bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847534.938073:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.938141:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595455616 00000100:00100000:3.0:1787847534.938150:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595455616 00000100:00100000:3.0:1787847534.938196:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:3.0:1787847534.938205:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+31:14513:x1874693595455616:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:3.0:1787847534.938227:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787847534.938243:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b98631c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1140 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.938290:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b98631c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1140 expref: 32 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.938299:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b98631c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1140 expref: 32 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.938311:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:3.0:1787847534.938313:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787847534.938323:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87ef8b6a00, rc 0) 00000100:00100000:3.0:1787847534.938368:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+32:14513:x1874693595455616:12345-192.168.201.21@tcp:101:bash.0 Request processed in 165us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847534.938373:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 42 00000100:00100000:2.0:1787847534.944443:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847534.944624:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595455744 00000100:00100000:0.0:1787847534.944633:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595455744 00000100:00100000:0.0:1787847534.944759:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:0.0:1787847534.944771:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+32:14513:x1874693595455744:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847534.944794:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847534.944816:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98631c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1147 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.944922:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.945137:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 33 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.945148:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.945184:0:14360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 33 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.945198:0:14360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 33 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847534.945212:0:14360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1874693616411904:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847534.945331:0:14360:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787847534.947909:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847534.948188:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595455872 00000100:00100000:2.0:1787847534.948197:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595455872 00010000:00010000:2.0:1787847534.948237:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 34 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847534.948282:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:2.0:1787847534.948292:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+34:2346:x1874693595455872:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847534.948307:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847534.948314:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 34 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.948340:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 34 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.948363:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:2.0:1787847534.948369:0:14345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.948378:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.948386:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847534.948404:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847534.948467:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+34:2346:x1874693595455872:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 177us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847534.948476:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00010000:00010000:0.0:1787847534.951632:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7400/0x1835de88b98631ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1139 expref: 33 pid: 14358 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847534.951661:0:14360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14360:1874693616411904:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847534.951686:0:14360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.951697:0:14360:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.951704:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847534.951750:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787847534.951755:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847534.951774:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.951809:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b98631c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1147 expref: 33 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.951824:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1147 expref: 32 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.951832:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847534.951835:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787847534.951838:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:0.0:1787847534.951913:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+32:14513:x1874693595455744:12345-192.168.201.21@tcp:101:bash.0 Request processed in 7145us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847534.951923:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 43 00000100:00100000:1.0:1787847534.958405:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847534.958502:0:16586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595456128 00000100:00100000:0.0:1787847534.958513:0:16586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595456128 00000100:00100000:0.0:1787847534.958595:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:0.0:1787847534.958606:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+32:14513:x1874693595456128:12345-192.168.201.21@tcp:103:bash.0 00010000:00010000:0.0:1787847534.958624:0:16586:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787847534.958658:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1147 expref: 32 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.958680:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b6a00/0x1835de88b98631c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1140 expref: 31 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.958691:0:16586:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c7207600) 00010000:00010000:0.0:1787847534.958701:0:16586:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847534.958765:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+30:14513:x1874693595456128:12345-192.168.201.21@tcp:103:bash.0 Request processed in 161us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847534.958775:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 2 00000100:00100000:2.0:1787847534.964231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847534.964417:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595456256 00000100:00100000:3.0:1787847534.964437:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595456256 00000100:00100000:3.0:1787847534.964501:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:3.0:1787847534.964512:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+30:14513:x1874693595456256:12345-192.168.201.21@tcp:58:bash.0 00010000:00010000:3.0:1787847534.964635:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.964652:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847534.964664:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787847534.965500:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787847534.965654:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787847534.965722:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787847534.965829:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+30:14513:x1874693595456256:12345-192.168.201.21@tcp:58:bash.0 Request processed in 1316us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847534.965840:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 44 00000100:00100000:2.0:1787847534.969727:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847534.969831:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595456384 00000100:00100000:0.0:1787847534.969841:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595456384 00000100:00100000:0.0:1787847534.969907:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 45 00000100:00100000:0.0:1787847534.969918:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+30:14513:x1874693595456384:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:0.0:1787847534.969975:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847534.970002:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d114e expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.970070:0:14360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.970082:0:14360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 31 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.970116:0:14360:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.970128:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 31 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.970142:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:0.0:1787847534.970145:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787847534.970149:0:14360:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 31 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847534.970157:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6aff400, rc 0) 00000100:00100000:0.0:1787847534.970221:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+31:14513:x1874693595456384:12345-192.168.201.21@tcp:101:bash.0 Request processed in 305us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847534.970228:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 45 00010000:00010000:2.0:1787847535.196597:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787847535.260606:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:1.0:1787847535.260630:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1787847535.260638:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:1.0:1787847535.260662:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:0.0:1787847535.575208:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787847535.575218:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847535.575258:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787847535.575264:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787847535.575389:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1874693616412032:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787847535.576800:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87d0a97d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787847535.583293:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1874693616412032:192.168.201.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787847535.584027:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.584344:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595456512 00000100:00100000:0.0:1787847535.584352:0:14369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595456512 00000100:00100000:0.0:1787847535.584414:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:0.0:1787847535.584425:0:14369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595456512:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787847535.584902:0:14369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595456512:12345-192.168.201.21@tcp:900:lhsmtool_posix.0 Request processed in 107us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.584908:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 0 00000100:00100000:2.0:1787847535.588585:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.589445:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595456640 00000100:00100000:0.0:1787847535.589457:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595456640 00000100:00100000:0.0:1787847535.589528:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:0.0:1787847535.589538:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595456640:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787847535.589570:0:14359:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787847535.589701:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595456640:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 164us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.589709:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 46 00000100:00100000:1.0:1787847535.595745:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847535.599194:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595456768 00000100:00100000:3.0:1787847535.599210:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595456768 00000100:00100000:2.0:1787847535.599420:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:2.0:1787847535.599431:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595456768:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787847535.599513:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599541:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599565:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599581:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599588:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599594:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599618:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599625:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599641:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847535.599681:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787847535.599686:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787847535.599701:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599712:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599718:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599734:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599739:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847535.599743:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599751:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599764:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847535.599767:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847535.599771:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599777:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c600/0x1835de88b98631e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599790:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599797:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599802:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599807:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847535.599809:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599822:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599830:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d87c4d7fe00) 00010000:00010000:2.0:1787847535.599832:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847535.599835:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599840:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d800/0x1835de88b98631ec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599853:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599859:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599863:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599867:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165c800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847535.599869:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599874:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599880:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:2.0:1787847535.599882:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787847535.599885:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.599899:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b98631f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847535.600012:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595456768:12345-192.168.201.21@tcp:34:lhsmtool_posix.0 Request processed in 581us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847535.600022:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 47 00000100:00100000:3.0:1787847535.603709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.603842:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595457024 00000100:00100000:2.0:1787847535.603853:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595457024 00000100:00100000:2.0:1787847535.603907:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:2.0:1787847535.603917:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+10:14515:x1874693595457024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787847535.603956:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847535.603978:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98631fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1155 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604090:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604104:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604114:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847535.604124:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787847535.604242:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604249:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604273:0:14360:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604279:0:14360:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:2.0:1787847535.604282:0:14360:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604289:0:14360:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604300:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:2.0:1787847535.604303:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787847535.604307:0:14360:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604313:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863201 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604359:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98631fa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1155 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604369:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d87c3361300) 00010000:00010000:2.0:1787847535.604372:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847535.604376:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c200/0x1835de88b98631fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1155 expref: 12 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.604386:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c200, rc 0) 00000100:00100000:2.0:1787847535.604453:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+11:14515:x1874693595457024:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 537us (751us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1787847535.604470:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 48 00000100:00100000:1.0:1787847535.612353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.612496:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595457152 00000100:00100000:0.0:1787847535.612505:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595457152 00000100:00100000:0.0:1787847535.612576:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:0.0:1787847535.612587:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+11:14515:x1874693595457152:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787847535.612637:0:14358:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787847535.613242:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+11:14515:x1874693595457152:12345-192.168.201.21@tcp:53:lhsmtool_posix.0 Request processed in 654us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.613251:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 49 00000100:00100000:1.0:1787847535.623207:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.623963:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595457408 00000100:00100000:0.0:1787847535.623975:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595457408 00000100:00100000:0.0:1787847535.624049:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:0.0:1787847535.624059:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+11:14515:x1874693595457408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847535.624080:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847535.624101:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986320f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d115c expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787847535.625132:0:14359:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1787847535.625141:0:14359:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1787847535.625186:0:14359:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787847535.627843:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b9863216 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.627866:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b9863216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.627879:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b9863216 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.628012:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986320f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d115c expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.628033:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b9863216 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d115c expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.628043:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ed00) 00010000:00010000:1.0:1787847535.628046:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787847535.628049:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801879a00, rc 0) 00000100:00100000:1.0:1787847535.628124:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595457408:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 4066us (4927us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1787847535.628133:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 50 00000100:00100000:3.0:1787847535.637034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.637184:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595457664 00000100:00100000:0.0:1787847535.637195:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595457664 00000100:00100000:0.0:1787847535.637257:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:0.0:1787847535.637279:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595457664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787847535.637351:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847535.637377:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b9863216 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d115c expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637394:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ed00) 00010000:00010000:0.0:1787847535.637406:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787847535.637442:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637456:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637466:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637480:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637487:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637493:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637767:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637775:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637781:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637787:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6afe600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847535.637792:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637800:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637809:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:0.0:1787847535.637813:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847535.637816:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637822:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b9863224 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637830:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637836:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637841:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637852:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847535.637856:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637861:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637868:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf75a6e2a (ffff8d87c7207600) 00010000:00010000:0.0:1787847535.637870:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787847535.637873:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.637878:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b986322b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf75a6e2a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847535.638010:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+12:14515:x1874693595457664:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 723us (976us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787847535.638018:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 51 00000100:00100000:2.0:1787847535.644536:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847535.644625:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595457792 00000100:00100000:1.0:1787847535.644636:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595457792 00000100:00100000:1.0:1787847535.644699:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:1.0:1787847535.644710:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+12:14515:x1874693595457792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787847535.644734:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787847535.644757:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879200/0x1835de88b9863232 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1163 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.644797:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878a00/0x1835de88b9863239 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.644811:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878a00/0x1835de88b9863239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.644822:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878a00/0x1835de88b9863239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.644952:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879200/0x1835de88b9863232 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1163 expref: 14 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.644971:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878a00/0x1835de88b9863239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1163 expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.644980:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:1.0:1787847535.644983:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787847535.644987:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d8801878a00, rc 0) 00000100:00100000:1.0:1787847535.645058:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595457792:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 350us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847535.645066:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 52 00000100:00100000:3.0:1787847535.648311:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.648430:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595458048 00000100:00100000:2.0:1787847535.648441:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595458048 00000100:00100000:2.0:1787847535.648504:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 53 00000100:00100000:2.0:1787847535.648513:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d86c1dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595458048:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787847535.648617:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.648636:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.648648:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787847535.649202:0:14360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787847535.649215:0:14360:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450473282229ns, next at 451473279212ns, rc = 0 00000004:00010000:2.0:1787847535.649306:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002392d500 reply state 00000000efe09bb3 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847535.649315:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847535.649419:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d86c1dbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+15:14515:x1874693595458048:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 904us (1114us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787847535.649427:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 53 00010000:00010000:0.0:1787847535.651253:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651271:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651279:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651286:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165d600 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:0.0:1787847535.651290:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651310:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651337:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:0.0:1787847535.651340:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787847535.651345:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651351:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165d600/0x1835de88b9863240 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847535.651727:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.651793:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595458176 00000100:00100000:0.0:1787847535.651801:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595458176 00000100:00100000:0.0:1787847535.651856:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:0.0:1787847535.651865:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+14:14515:x1874693595458176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847535.651886:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847535.651904:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d116a expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.651994:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.652017:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.652036:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:0.0:1787847535.652039:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787847535.652042:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6affe00, rc 0) 00000100:00100000:0.0:1787847535.652101:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efbc6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+15:14515:x1874693595458176:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 237us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.652108:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 54 00000100:00100000:3.0:1787847535.662453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.662810:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595458304 00000100:00100000:0.0:1787847535.662821:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595458304 00000100:00100000:0.0:1787847535.662908:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:0.0:1787847535.662919:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2346:x1874693595458304:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787847535.663305:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87d2170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2346:x1874693595458304:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 387us (863us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787847535.663314:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00080000:1.0:1787847535.663322:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847535.669292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847535.669396:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595458560 00000100:00100000:3.0:1787847535.669405:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595458560 00000100:00100000:3.0:1787847535.669476:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1787847535.669487:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+15:14515:x1874693595458560:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787847535.669733:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+16:14515:x1874693595458560:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 247us (449us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787847535.669741:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 11 00000100:00100000:3.0:1787847535.678593:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847535.678696:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595458816 00000100:00100000:1.0:1787847535.678707:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595458816 00000100:00100000:1.0:1787847535.678767:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:1.0:1787847535.678777:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+16:14515:x1874693595458816:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787847535.678899:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+16:14515:x1874693595458816:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 122us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847535.678906:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 55 00000100:00100000:2.0:1787847535.681789:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.681889:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595458944 00000100:00100000:0.0:1787847535.681899:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595458944 00000100:00100000:0.0:1787847535.681993:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:0.0:1787847535.682012:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+16:14515:x1874693595458944:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847535.682031:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847535.682056:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986324e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1171 expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.682141:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9863255 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.682156:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9863255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.682168:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9863255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787847535.682209:0:14360:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787847535.682251:0:14360:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9863255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.682280:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afe600/0x1835de88b986324e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1171 expref: 18 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.682302:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9863255 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1171 expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.682312:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:0.0:1787847535.682316:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787847535.682319:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afec00, rc 0) 00000100:00100000:0.0:1787847535.682381:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14515:x1874693595458944:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 371us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.682389:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 56 00000100:00100000:2.0:1787847535.687548:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.687629:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595459072 00000100:00100000:0.0:1787847535.687639:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595459072 00000100:00100000:0.0:1787847535.687698:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:0.0:1787847535.687709:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d880052e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2346:x1874693595459072:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847535.687729:0:15045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847535.687749:0:15045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1178 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787847535.687778:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a906370, blocks: 0x1 00010000:00010000:0.0:1787847535.687801:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=450s v=(0 0) 00010000:00010000:0.0:1787847535.687806:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847535.687818:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 7 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.687859:0:15045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 7 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.687873:0:15045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afee00, rc 0) 00000100:00100000:0.0:1787847535.687971:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d880052e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:2346:x1874693595459072:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 264us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.687979:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:3.0:1787847535.693993:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.694105:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595459328 00000100:00100000:0.0:1787847535.694115:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595459328 00000100:00100000:0.0:1787847535.694177:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:0.0:1787847535.694188:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14515:x1874693595459328:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787847535.694295:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d88005261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14515:x1874693595459328:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 109us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.694304:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 57 00000100:00100000:2.0:1787847535.697732:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847535.699222:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595459456 00000100:00100000:1.0:1787847535.699237:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595459456 00000100:00100000:1.0:1787847535.699320:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:1.0:1787847535.699332:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14515:x1874693595459456:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787847535.761655:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1787847535.762337:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:2.0:1787847535.762345:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787847535.762369:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:2.0:1787847535.762614:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616412160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787847535.762686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787847535.763177:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616412160 00000100:00100000:3.0:1787847535.763186:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616412160 00000100:00100000:2.0:1787847535.763374:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787847535.763384:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1874693616412160:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787847535.763561:0:15573:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787847535.763565:0:15573:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787847535.763567:0:15573:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787847535.763570:0:15573:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787847536 -> 1787847536 00002000:00010000:2.0:1787847535.763573:0:15573:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787847535.763624:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1874693616412160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (936us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787847535.763631:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1787847535.763677:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d87e6d292c0/2, rc 0, transno 8589934595 00000100:00100000:2.0:1787847535.763682:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616412160:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1787847535.763974:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847535.764887:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595459456:12345-192.168.201.21@tcp:44:lhsmtool_posix.0 Request processed in 65552us (67160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847535.764899:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 58 00000100:00100000:1.0:1787847535.769290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.769702:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595459584 00000100:00100000:2.0:1787847535.769713:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595459584 00000100:00100000:2.0:1787847535.769776:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1787847535.769784:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:2347:x1874693595459584:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787847535.769886:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:2347:x1874693595459584:12345-192.168.201.21@tcp:16:lhsmtool_posix.0 Request processed in 102us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847535.769894:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:3.0:1787847535.773062:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.773478:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595459840 00000100:00100000:2.0:1787847535.773488:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595459840 00000100:00100000:2.0:1787847535.773578:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:2.0:1787847535.773589:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595459840:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787847535.773656:0:14360:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847535.773684:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6afec00/0x1835de88b9863255 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1171 expref: 13 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.773702:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:2.0:1787847535.773706:0:14360:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787847535.773749:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.773762:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.773771:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787847535.774053:0:14360:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000854237b7 reply state 000000005ffa414a transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847535.774062:0:14360:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787847535.774278:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+14:14515:x1874693595459840:12345-192.168.201.21@tcp:36:lhsmtool_posix.0 Request processed in 689us (1227us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787847535.774286:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 59 00000100:00100000:1.0:1787847535.777312:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.777559:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595459968 00000100:00100000:0.0:1787847535.777569:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595459968 00000100:00100000:0.0:1787847535.777637:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1787847535.777647:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:14515:x1874693595459968:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787847535.777665:0:15573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787847535.777685:0:15573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d117f expref: -99 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.777716:0:15573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.777737:0:15573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847535.777741:0:15573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787847535.777747:0:15573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 8 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.777782:0:15573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.777796:0:15573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847535.777808:0:15573:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15573:1874693616412288:192.168.201.21@tcp:104: 00000100:00100000:0.0:1787847535.777899:0:15573:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d880012ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1787847535.778278:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847535.778288:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847535.778295:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847535.778301:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c165dc00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:3.0:1787847535.778306:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847535.778313:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847535.778332:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:3.0:1787847535.778336:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787847535.778349:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787847535.778357:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165dc00/0x1835de88b9863263 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847535.780584:0:15573:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15573:1874693616412288:192.168.201.21@tcp:104: 00010000:00010000:0.0:1787847535.780630:0:15573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 8 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.780649:0:15573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c6afe600, rc 0) 00000100:00100000:0.0:1787847535.780710:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+8:14515:x1874693595459968:12345-192.168.201.21@tcp:101:lhsmtool_posix.0 Request processed in 3064us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.780719:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1787847535.783456:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.783561:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460096 00000100:00100000:2.0:1787847535.783571:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460096 00010000:00010000:2.0:1787847535.783613:0:14345:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847535.783662:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:2.0:1787847535.783691:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+8:2346:x1874693595460096:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847535.783706:0:14345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847535.783737:0:14345:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.783750:0:14345:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.783775:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000524385a2/0x1835de88b986325c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1178 expref: 8 pid: 15045 timeout: 550 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.783790:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847535.783795:0:14345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847535.783801:0:14345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 7 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.783811:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 7 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.783846:0:14345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 7 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847535.783873:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e12bd680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14345:1874693616412416:192.168.201.21@tcp:105: 00000100:00100000:2.0:1787847535.784265:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87e6f33c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787847535.787225:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e12bd680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14345:1874693616412416:192.168.201.21@tcp:105: 00010000:00010000:0.0:1787847535.787267:0:14345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847535.787329:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:2346:x1874693595460096:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 3639us (3881us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.787341:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:3.0:1787847535.791656:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.791764:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460224 00000100:00100000:2.0:1787847535.791790:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460224 00000100:00100000:2.0:1787847535.791856:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1787847535.791867:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800526580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:2347:x1874693595460224:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787847535.792125:0:15045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787847535.792129:0:15045:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787847535 00002000:00010000:2.0:1787847535.792132:0:15045:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787847533 00002000:00010000:2.0:1787847535.792211:0:15045:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787847536 -> 1787847535 00002000:00010000:2.0:1787847535.792216:0:15045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787847535.792280:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800526580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+8:2347:x1874693595460224:12345-192.168.201.21@tcp:2:lhsmtool_posix.0 Request processed in 415us (634us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787847535.792289:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:0.0:1787847535.800051:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847535.800488:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460352 00000100:00100000:1.0:1787847535.800499:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460352 00000100:00100000:1.0:1787847535.800609:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:1.0:1787847535.800622:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+8:2345:x1874693595460352:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787847535.800670:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.800692:0:15042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 8 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.800714:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787847535.800719:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787847535.800724:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.800759:0:15042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 8 pid: 15573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.800774:0:15042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 8 pid: 15573 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.800812:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15042:1874693616412544:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847535.800906:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746300 going to sleep for 11 seconds 00000100:00100000:0.0:1787847535.812975:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.813559:0:16586:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460480 00000100:00100000:2.0:1787847535.813569:0:16586:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460480 00010000:00010000:2.0:1787847535.813616:0:16586:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 9 pid: 15573 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787847535.813665:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:2.0:1787847535.813675:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:2346:x1874693595460480:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787847535.813692:0:16586:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787847535.813727:0:16586:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 9 pid: 15573 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.813741:0:16586:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 9 pid: 15573 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.813766:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847535.813785:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787847535.813791:0:16586:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.813801:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.813822:0:16586:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787847535.813966:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+9:2346:x1874693595460480:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 292us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847535.813974:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00010000:00010000:1.0:1787847535.814462:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089445ec0/0x1835de88b986326a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d117f expref: 8 pid: 15573 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.814481:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15042:1874693616412544:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847535.814502:0:15042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814512:0:15042:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814519:0:15042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814544:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814552:0:15042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814559:0:15042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814582:0:15042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879800 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847535.814586:0:15042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814595:0:15042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814606:0:15042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.814614:0:15042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000170118f7/0x1835de88b9863271 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.814673:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e6d2a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:2345:x1874693595460352:12345-192.168.201.21@tcp:1:lhsmtool_posix.0 Request processed in 14053us (14632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847535.814681:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:3.0:1787847535.822845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847535.823207:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460736 00000100:00100000:1.0:1787847535.823472:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460736 00000100:00100000:1.0:1787847535.823577:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 60 00000100:00100000:1.0:1787847535.823589:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+13:14515:x1874693595460736:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787847535.823663:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.823679:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.823714:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.824120:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.824129:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.824135:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.824167:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.824180:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 14 pid: 14358 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.824195:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1874693616412672:192.168.201.21@tcp:104: 00000100:00100000:1.0:1787847535.824286:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746300 going to sleep for 11 seconds 00000100:00100000:1.0:1787847535.826744:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1874693616412672:192.168.201.21@tcp:104: 00010000:00010000:1.0:1787847535.826773:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787847535.827044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.827260:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460864 00000100:00100000:0.0:1787847535.827268:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460864 00010000:00010000:0.0:1787847535.827306:0:14344:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 15 pid: 14358 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787847535.827415:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:0.0:1787847535.827426:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+15:2346:x1874693595460864:12345-192.168.201.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787847535.827442:0:14344:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787847535.827449:0:14344:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 15 pid: 14358 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.827462:0:14344:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 15 pid: 14358 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.827485:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863247 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d116a expref: 15 pid: 14358 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.827500:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:0.0:1787847535.827505:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.827514:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.827534:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.827564:0:14344:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787847535.827620:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+14:2346:x1874693595460864:12345-192.168.201.21@tcp:103:ldlm_bl.0 Request processed in 196us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847535.827628:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00010000:00010000:1.0:1787847535.827787:0:14359:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.827795:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787847535.828017:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787847535.828163:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1787847535.828212:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1787847535.828305:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1874693616412800:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787847535.828351:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847535.828392:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c87469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787847535.828574:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616412800 00000100:00100000:3.0:1787847535.828580:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616412800 00000100:00100000:3.0:1787847535.828622:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787847535.828630:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14359:x1874693616412800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787847535.828828:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14359:x1874693616412800:12345-0@lo:1000:mdt00_001.0 Request processed in 199us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847535.828835:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787847535.828839:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1874693616412800:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787847535.829736:0:14359:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1787847535.829800:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1874693616412928:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787847535.829838:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847535.829869:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746300 going to sleep for 11 seconds 00000100:00100000:3.0:1787847535.830015:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616412928 00000100:00100000:3.0:1787847535.830021:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616412928 00000100:00100000:3.0:1787847535.830101:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787847535.830111:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14359:x1874693616412928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787847535.830253:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14359:x1874693616412928:12345-0@lo:1000:mdt00_001.0 Request processed in 143us (414us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787847535.830260:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787847535.830320:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8e940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14359:1874693616412928:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787847535.830350:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830359:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830366:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830383:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.830388:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830400:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830427:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:1.0:1787847535.830430:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787847535.830434:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830441:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b986327f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830469:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830476:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830482:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830487:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87ef8b7a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.830490:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830496:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830503:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:1.0:1787847535.830505:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787847535.830511:0:14359:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830521:0:14359:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830536:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.830584:0:14359:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6aff400/0x1835de88b98631de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d114e expref: 17 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.830596:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1874693616413056:192.168.201.21@tcp:105: 00000100:00100000:1.0:1787847535.830662:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d87c8746540 going to sleep for 11 seconds 00000100:00100000:1.0:1787847535.834876:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8e580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14359:1874693616413056:192.168.201.21@tcp:105: 00010000:00010000:1.0:1787847535.834909:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.834919:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87ef8b7a00/0x1835de88b98631d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835038:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835053:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835065:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835076:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835082:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835104:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835109:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801878800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.835113:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835120:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835132:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:1.0:1787847535.835135:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847535.835139:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835145:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b9863286 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835155:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835161:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835166:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835171:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.835174:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835190:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835198:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:1.0:1787847535.835200:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787847535.835203:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.835302:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b9863278 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.835707:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14515:x1874693595460736:12345-192.168.201.21@tcp:57:lhsmtool_posix.0 Request processed in 12117us (12866us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1787847535.835727:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 60 00000020:00080000:1.0:1787847535.835734:0:14359:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787847535.836510:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787847535.836517:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787847535.836566:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787847535.836574:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787847535.836844:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847535.836911:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595460992 00000100:00100000:3.0:1787847535.836920:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595460992 00000100:00100000:3.0:1787847535.836991:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1787847535.837012:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14513:x1874693595460992:12345-192.168.201.21@tcp:49:bash.0 00000100:00100000:3.0:1787847535.837147:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14513:x1874693595460992:12345-192.168.201.21@tcp:49:bash.0 Request processed in 138us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787847535.837161:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 12 00000100:00100000:3.0:1787847535.840685:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:3.0:1787847535.844265:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.844357:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595461120 00000100:00100000:2.0:1787847535.844366:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595461120 00000100:00100000:2.0:1787847535.844437:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:2.0:1787847535.844447:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800525e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+7:14513:x1874693595461120:12345-192.168.201.21@tcp:101:bash.0 00010000:00010000:2.0:1787847535.844467:0:15045:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847535.844488:0:15045:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1690360/0x1835de88b986328d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d1186 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787847535.844517:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a90636f, atime: 0x6a90636d, ctime: 0x6a90636f, blocks: 0x1 00010000:00010000:2.0:1787847535.844539:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1787847535.844543:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787847535.844558:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1690360/0x1835de88b986328d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1186 expref: 8 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.844576:0:15045:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1690360/0x1835de88b986328d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d1186 expref: 8 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.844610:0:15045:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165d600, rc 0) 00000100:00100000:2.0:1787847535.844667:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800525e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+8:14513:x1874693595461120:12345-192.168.201.21@tcp:101:bash.0 Request processed in 222us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847535.844673:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:0.0:1787847535.844968:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595461376 00000100:00100000:0.0:1787847535.844973:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595461376 00000100:00100000:0.0:1787847535.845018:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 13 00000100:00100000:0.0:1787847535.845026:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800524f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+17:14515:x1874693595461376:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787847535.845836:0:14362:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787847535.847556:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:3.0:1787847535.847691:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00010000:00010000:0.0:1787847535.847697:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.847714:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.847725:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.847733:0:14362:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.847755:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.847761:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787847535.847779:0:14362:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787847535.847868:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800524f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+19:14515:x1874693595461376:12345-192.168.201.21@tcp:35:lhsmtool_posix.0 Request processed in 2841us (5178us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787847535.847877:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 13 00000020:00080000:0.0:1787847535.847883:0:14362:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787847535.847903:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595461632 00000100:00100000:0.0:1787847535.847910:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595461632 00000100:00100000:0.0:1787847535.847951:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 14 00000100:00100000:0.0:1787847535.847958:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800525a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+19:14513:x1874693595461632:12345-192.168.201.21@tcp:35:bash.0 00000001:00080000:0.0:1787847535.848147:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1787847535.848243:0:14362:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1787847535.848307:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800525a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+22:14513:x1874693595461632:12345-192.168.201.21@tcp:35:bash.0 Request processed in 349us (619us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1787847535.848315:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 14 00000020:00080000:0.0:1787847535.848318:0:14362:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1787847535.848568:0:14348:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787847535.848576:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.848584:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d87c6affe00 already unused, calling callback (ffffffffc1555440) 00010000:00010000:1.0:1787847535.848588:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.848596:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.848610:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d87e122ee00) 00010000:00010000:1.0:1787847535.848613:0:14348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787847535.848625:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.848631:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c6affe00/0x1835de88b9863294 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.848643:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847535.848644:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787847535.848646:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847535.944267:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847535.944857:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595461888 00000100:00100000:2.0:1787847535.944868:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595461888 00000100:00100000:2.0:1787847535.944968:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:2.0:1787847535.944979:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800525680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+22:14525:x1874693595461888:12345-192.168.201.21@tcp:101:lfs.0 00010000:00010000:2.0:1787847535.945016:0:14360:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787847535.945038:0:14360:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986329b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8771fcfdbc0d118d expref: -99 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787847535.945315:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787847535.945513:0:14360:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986329b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d118d expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.945542:0:14360:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d87c4d7f700) 00010000:00010000:2.0:1787847535.945545:0:14360:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787847535.945551:0:14360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d87c165c800/0x1835de88b986329b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.21@tcp remote: 0x8771fcfdbc0d118d expref: 24 pid: 14360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787847535.945566:0:14360:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d87c165c800, rc 0) 00000100:00100000:2.0:1787847535.945636:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800525680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14525:x1874693595461888:12345-192.168.201.21@tcp:101:lfs.0 Request processed in 658us (1377us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1787847535.945643:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 61 00000100:00100000:2.0:1787847535.959784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:1.0:1787847535.959897:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462016 00000100:00100000:1.0:1787847535.959908:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462016 00000100:00100000:1.0:1787847535.960018:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:1.0:1787847535.960029:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14525:x1874693595462016:12345-192.168.201.21@tcp:34:lfs.0 00010000:00010000:1.0:1787847535.960109:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960134:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960148:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960164:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960172:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960178:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960637:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960652:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960660:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787847535.960698:0:14359:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960710:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960716:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960723:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960729:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.960732:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960740:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960751:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d87c7207a00) 00010000:00010000:1.0:1787847535.960754:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847535.960759:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960764:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879800/0x1835de88b98632a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960783:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960788:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960793:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960799:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801878800 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.960801:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960807:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960815:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d87e122ea00) 00010000:00010000:1.0:1787847535.960817:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847535.960820:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960825:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801878800/0x1835de88b98632b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960838:0:14359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960844:0:14359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960849:0:14359:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960860:0:14359:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d8801879a00 already unused, calling callback (ffffffffc1f854f0) 00010000:00010000:1.0:1787847535.960863:0:14359:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960868:0:14359:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960877:0:14359:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d87c3361100) 00010000:00010000:1.0:1787847535.960879:0:14359:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787847535.960882:0:14359:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787847535.960887:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d8801879a00/0x1835de88b98632b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14359 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787847535.961126:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87e12bd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14525:x1874693595462016:12345-192.168.201.21@tcp:34:lfs.0 Request processed in 1097us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847535.961136:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 62 00000100:00100000:3.0:1787847535.964268:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:0.0:1787847535.964368:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462272 00000100:00100000:0.0:1787847535.964378:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462272 00000100:00100000:0.0:1787847535.964440:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 15 00000100:00100000:0.0:1787847535.964451:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+23:14525:x1874693595462272:12345-192.168.201.21@tcp:35:lfs.0 00000100:00100000:0.0:1787847535.964963:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+24:14525:x1874693595462272:12345-192.168.201.21@tcp:35:lfs.0 Request processed in 482us (675us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1787847535.964981:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 15 00010000:00010000:3.0:1787847536.215290:0:16474:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787847536.727333:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787847536.727364:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87e6d28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616413184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847536.727450:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847536.736099:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413184 00000100:00100000:0.0:1787847536.736115:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413184 00000100:00100000:2.0:1787847536.736206:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787847536.736231:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787847536.736244:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d8800526940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616413184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787847536.736281:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787847536.736358:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d8800526940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1874693616413184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (8908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847536.736366:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787847536.736789:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616413312:0@lo:400:kworker.0 00000100:00100000:2.0:1787847536.736834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847536.736902:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787847536.736909:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616413440:0@lo:400:kworker.0 00000100:00100000:2.0:1787847536.736950:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847536.736998:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616413568:0@lo:400:kworker.0 00000100:00100000:2.0:1787847536.737022:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847536.737069:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616413696:0@lo:400:kworker.0 00000100:00100000:2.0:1787847536.737096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787847536.737113:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787847536.737118:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87f7f9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616413824:0@lo:400:kworker.0 00000100:00100000:0.0:1787847536.737153:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413312 00000100:00100000:0.0:1787847536.737158:0:14353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413312 00000100:00100000:0.0:1787847536.737190:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787847536.737196:0:14353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3302:x1874693616413312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847536.737230:0:14353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1d674ef9-f2fc-448e-8206-e13ebe069dba+19:3302:x1874693616413312:12345-0@lo:400:kworker.0 Request processed in 34us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847536.737237:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787847536.737269:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413440 00000100:00100000:0.0:1787847536.737272:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413440 00000100:00100000:2.0:1787847536.737287:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787847536.737298:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787847536.737304:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616413440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847536.737321:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1d674ef9-f2fc-448e-8206-e13ebe069dba:3302:1874693616413312:0@lo:400:kworker.0 00000100:00100000:0.0:1787847536.737336:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616413440:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847536.737342:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787847536.737346:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413568 00000100:00100000:2.0:1787847536.737349:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413568 00000100:00100000:0.0:1787847536.737357:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413696 00000100:00100000:0.0:1787847536.737360:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413696 00000100:00100000:1.0:1787847536.737397:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413824 00000100:00100000:1.0:1787847536.737401:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413824 00000100:00100000:2.0:1787847536.737623:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787847536.737631:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616413568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787847536.737667:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1874693616413568:12345-0@lo:400:kworker.0 Request processed in 37us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847536.737673:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787847536.741356:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787847536.741368:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787847536.741457:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87e6d28b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1874693616413184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787847536.741602:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1874693616413568:0@lo:400:kworker.0 00000100:00100000:3.0:1787847536.741619:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616413440:0@lo:400:kworker.0 00000100:00100000:0.0:1787847536.741887:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787847536.741913:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616413696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787847536.742034:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1874693616413696:12345-0@lo:400:kworker.0 Request processed in 125us (4936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847536.742042:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787847536.742396:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1874693616413696:0@lo:400:kworker.0 00000100:00100000:1.0:1787847536.747450:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787847536.748133:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616413824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787847536.748246:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1874693616413824:12345-0@lo:400:kworker.0 Request processed in 781us (10956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847536.748255:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787847536.748321:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87f7f9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1874693616413824:0@lo:400:kworker.0 00010000:00010000:2.0:1787847537.239251:0:14347:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787847537.240313:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787847537.240335:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d87efa8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616413952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787847537.240405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787847537.240475:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693616413952 00000100:00100000:1.0:1787847537.240482:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693616413952 00000100:00100000:1.0:1787847537.240537:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787847537.240545:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87efa8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616413952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787847537.240592:0:15047:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787847537.240639:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87efa8cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1874693616413952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787847537.240646:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787847537.240667:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787847537.240702:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d87efa8e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1874693616413952:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787847537.303255:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:1.0:1787847537.303272:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1787847537.303278:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1787847537.303284:0:6706:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:02000400:0.0:1787847537.304577:0:16626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1787847538.097815:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098027:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098093:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098128:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098147:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098170:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098201:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.21@tcp (source: 12345-192.168.201.21@tcp) 00000100:00100000:2.0:1787847538.098229:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462912 00000100:00100000:2.0:1787847538.098240:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462912 00000100:00100000:2.0:1787847538.098311:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462528 00000100:00100000:2.0:1787847538.098315:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462528 00000100:00100000:2.0:1787847538.098334:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1787847538.098342:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2346:x1874693595462912:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847538.098425:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d4971f63-4888-4fa1-9431-68a53bc776d7+6:2346:x1874693595462912:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 82us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847538.098433:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 25 00000100:00100000:2.0:1787847538.098451:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00100000:2.0:1787847538.098457:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+24:2346:x1874693595462528:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847538.098484:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+24:2346:x1874693595462528:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 28us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847538.098490:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 26 00000100:00080000:2.0:1787847538.098507:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787847538.098540:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462656 00000100:00100000:2.0:1787847538.098544:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462656 00000100:00100000:2.0:1787847538.098585:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595463168 00000100:00100000:2.0:1787847538.098588:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595463168 00000100:00100000:2.0:1787847538.098598:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462784 00000100:00100000:2.0:1787847538.098601:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462784 00000100:00100000:2.0:1787847538.098611:0:15573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595463040 00000100:00100000:2.0:1787847538.098613:0:15573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595463040 00000100:00100000:2.0:1787847538.098639:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1787847538.098645:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2346:x1874693595462656:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847538.098681:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+6:2346:x1874693595462656:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 36us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847538.098688:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 16 00000100:00100000:2.0:1787847538.098701:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1787847538.098707:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2346:x1874693595463168:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847538.098729:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2346:x1874693595463168:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 23us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847538.098735:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 17 00000100:00100000:2.0:1787847538.098746:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1787847538.098752:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2346:x1874693595462784:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847538.098773:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ac42b2e5-4ebb-4fe7-899a-e9b4c0d6b114+5:2346:x1874693595462784:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 21us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847538.098779:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 18 00000100:00100000:2.0:1787847538.098789:0:15573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00100000:2.0:1787847538.098796:0:15573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2346:x1874693595463040:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:2.0:1787847538.098819:0:15573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d4971f63-4888-4fa1-9431-68a53bc776d7+5:2346:x1874693595463040:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 23us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1787847538.098825:0:15573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 19 00000100:00080000:2.0:1787847538.098839:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787847538.098842:0:14355:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787847538.107770:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874693595462400 00000100:00100000:0.0:1787847538.107786:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874693595462400 00000100:00100000:0.0:1787847538.107878:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.21@tcp, seq: 122 00000100:00100000:0.0:1787847538.107889:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d87f91ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2346:x1874693595462400:12345-192.168.201.21@tcp:400:kworker.0 00000100:00100000:0.0:1787847538.108012:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d87f91ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dc4bbe44-cbca-4879-9fe4-807cbb8b1b3c+13:2346:x1874693595462400:12345-192.168.201.21@tcp:400:kworker.0 Request processed in 124us (10208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787847538.108020:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.21@tcp, seq: 122 00010000:00010000:3.0:1787847538.267350:0:14348:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29623 lines, 29623 kept, 0 dropped, 0 bad.